a 


Bee kee reees 
Srduehclinn barpeasete ne 


Sn wh 
fan mines 


Digitized by the Internet Archive 
In 2022 with funding from 
University of Alberta Library 


https://archive.org/details/Betty 1977 


f ri : P Fe 
Ae tm eek a, oe me ve et ; i 


a ‘ eS m : ii ‘i ante ey ig 
. NTS. ac retain 
Th nek: ue Tp Cans = ie 

Mr | | hers dasmge ave) 
: laa aa ay sok Comtacs aC bi + 
| 20% wotthynsra seal sobtslo 
oD 1t wodzbgnena ces! goltslore? 


NAM a een i | ad nomesuesay 


ee aein aipaia'ae yg GA oisiale wine kG tw os ee ee 


Di, cedex iphiattte.  ONruaean’ saw 82 ail 
fq ’ : i ry i : ~ 7 j si | a 
i ha * " +o & 8 7 rien ee oe * si ee 2 oe e Lyer oa f TRPYARD 


\ 


” wrcantve oat oF hecdiise tp vdeton ei +o Leakorret 
‘ee | Bata Yo. 8 aakgou Lire emuhouge, ay wines are Re 


oteviag 18 asiqos: fone Lfo2 X10 ‘bre! oF bas atgaiyl! ty 


| st senoustey dog ones + OL} tamed’ Ke Pye: Atom 4 


bas any [por ieoeicia trasda© eoviIsess tid: are of! , | my 1 


si Rae enn oe ‘tied 2 SHetsRO evienstee 190 | eleody ony ae ong tem Oe 


vy 


er e one say, aati baduibow os sabwrottto Yo betateag od 
rite Bay gee Fee ah | ny . fk. trokabe terrct netoise. 


4 
5 YY. (Hscmis) eae 


ve Pee LRTROIA -Tuttnnntas 4 Bet 9 
i We ; $86 xod ee (s 
Pe tone ot. > ae 
ek Juda vel Liveatnom 
oe," il een ~ r 3 


leon (pa ied ea 
) 


Y teu ; ey a ; 

~ COCA OER «Led ; 

pre ro es 

* }  OFRE ia dot om a a 
ye 


at 


on ne fe | 


hd 


i 7 Ne, Pat 
a Co PULPTGMENT or vit RU) rsa ia ee ‘kena 


Dias “4h Pie ae es 
a or doeton. or Phsceertehee Piican 
ae n a ‘i v y ; ‘ ! r i me rn i ; "4 Thy > a 


J » ° ‘pa a ar | 


| omer oF, eisai | ae we 
Wane ay hak 

¥ oa ea ech | 

RAGS caw i 


‘SORMITTED. 10 me eat ie candoare atone abe WRSBARCH: 


wn . : con j eaten vr) ' ; 
y iF 7 1 1 [ ss F { - A aT F vi a | r , 1 Der So i 
; : a i i Lente \ ate v i) re . wh ly | 
> - ; u an ; es ‘ A ji i AD Teer ; re , 


Hi 
VAR 
it 


Lay a 


THE UNIVERSITY OF ALBERTA 


DEVELOPMENT AND CHARACTERIZATION OF CORRELATION 


INSTRUMENTATION FOR CHEMICAL MEASUREMENTS 


by 


KEITH ROGER BETTY 


A THESIS 
SUBMITTED TO THE FACULTY OF GRADUATE STUDIES AND RESEARCH 
IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE DEGREE 


OF DOCTOR) OF PHI noserre: 


DEPARTMENT OF CHEMISTRY 


EDMONTON, ALBERTA 


SPRING, 1977 


\ atl Ob, ay 


+0 , re ne 


ue oy _ ie ane <maen a nea 


ee eee eS mh ee) 


* 


ceca aaa ee +0 6 0 ee OR? oe “e+e eee 


Dae none ee 


‘;. i 4 Bd Ah Da a a a ee . \ . y' if 
uv mt | A f oonege es 10% ednemot tye edd 6 tnsel Seige tes 
Be dak ie | cpitseoktag Bo ete 


ety Pah i" ; i 


ae wae eee a Keak vias aa | i 
jad asics ‘ aes came | - 

; "eewae ole © we ye wae y ; oy i BS), 
‘ Cine pea Tega st i: ee 


re 


oy . Petia Tas . 
ie en Rene chet ee AoG 


he ae ee 


ry babes atyre atl a Wn ed en eh ae ee ee 


Te Tedd Br A 


* tains » nat vim Anne . -* 


‘pain “no 


. op 
8 re om 


_- i 


ABSTRACT 


Many hardware and software processing operations 
Carried out on chemical data can be classified as 
correlation operations. These include such processes 
as signal-to-noise ratio enhancement using lock-in 
detection, autocorrelation, digital filtering, trans- 
versal filtering;differentiation, signal detection 
uSing matched filtering, and pattern recognition. 
Recent advances in solid-state electronics and in 
computer technology have facilitated both the hardware 
and software implementation of correlation data 
processing operations. It is shown in this study that 
such technological developments allow the evolution 
of powerful and inexpenSive systems for the correlation 
processing of chemical data. 

Lock-in amplification, which involves the cross- 
correlation of a periodically modulated signal with a 
reference waveform of the same frequency, is one of the 
most common Signal measurements used in the chemical 
labOratorys seine thert lrst (part Onecohase study. utes 
shown that the conventional design of a lock-in ampli- 
fier can be enhanced and simplified with a single in- 
tegrated circuit known as a phase locked loop. Then 
a new type of integrated circuit is described that is 


uniquely suited to the development of autocorrelation 
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instrumentation. Autocorrelation is an effective sig- 
nal processing technique for ee both the 
amplitude and frequency of a periodic signal buried 

in noise. A noisy Sine wave signal (S/N < 0.2) can 
eaSily be recovered using the autocorrelator. 

A particularly effective way of detecting and 
quantifying a specific spectral pattern in a complex 
spectral signal is sto cross-correlate the signal with 
the sought-for spectral pattern. A hardware cross- 
correlator based on a specially designed transient 
recorder was built and used in conjunction with a 
diode array spectrometer to measure the atomic emission 
of several elements in an inductively coupled plasma. 
The correlation approach provides a unique lock-and- 
key measurement that allows a highly automated and 
selective analytical measurement. 

A number of correlation signal processing opera- 
tions can be performed using software-based digital 
filters. Wests sshown ‘thatearvouriersidomain dagital 
filter (applied to the Fourier transform of a signal) 
based on a simple trapezoidal function forms a particu- 
larly versatile approach that can approximate the 
processing capabilities of the popular correlation fil- 
ters developed by Savitzky and Golay. Finally, it is 
shown that correlation filters such as those of Savitzky 


and Golay can be implemented on signals in real time by 
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using a new and powerful integrated circuit known as a 
tapped analog delay line. This device stores and 
makes available in parallel form a short sampled seg- 
ment of an input waveform. The characteristics and 
applications of this device to the correlation (trans- 
versal) filtering of analog signals in real time are 


discussed and illustrated in detail. 
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CHAPITE Rusk 


The technique of correlation has long been a 
ubiquitous part of the acquisition and treatment of 
Scientific data. An early worker in the field of com- 
munications was Lee (1), who later Pevieeed ene topic 
in detail (2). In chemistry, there have been several 
general treatments of correlation techniques (3-6) as 
well as a large number of detailed applications. Cor- 
relation, and the related techniques of convolution and 
Fourier transformation, can be implemented by instruments 
as conceptually simple as the lock-in amplifier, or as 
complex and expensive as the hardware correlators avail- 
able from companies such as Hewlett-Packard. It is 
also possible to perform correlations on a digital com- 
puter. The use of correlation methods has, however, been 
limited both by a lack of understanding of the technique, 
and, because of the frequent requirement to store and 
manipubatevarrays Of data, by the wlack»or High cost 
of the equipment required. Lately, the remarkable 
progress made in integrated-circuit technology has made 
devices available that can enable correlations to be 
performed simply and inexpensively by hardware, while 
the advent of the minicomputer and now the microcomputer 
has greatly increased the facility of software correla- 


tions. Because of the tremendous power of correlation 
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techniques to perform a wide variety of operations, and 
because of the universality of application of the re- 
Sulting instrumentation, the punnose of “thiis-work is 

to simplify the use of correlation for the measurement 
Of chemical data, both by the design of old instrumenta- 
tion in new ways and by the design of new instrumentation 
and techniques that can extract information in different 
ways. The resulting instrumentation can be used for 
tasks that vary from signal-to-noise ratio enhancement 
or resolution enhancement, to matched filtering and 
Dactern Lrecognitdonw. Initrvally;\s however, a brief intro= 
Suction to the mathematics, Of correlation, convolution, 
and Fourier transformation will be given. This discussion 
will be based in part on material presented elsewhere 
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What is Correlation? 

Correlation 1S.a computational technique for deter— 
mining the coherence within a signal, or between two 
Siaqnais, Mathematically, it 1s generally expressed as 


the correlation integral: 
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where Cap !T) ws "the correlation “funcetron "Of “the two 
srqonals#att)-and=b(t);“white*t its*their “relative dis- 
placement. Evaluation of this integral requires either 
a hardwired processor that might be analog or digital 
Gr both, “or "a *digital”computer. “*tThe calculation thus 
may be based either on a continuous function over the 
eicerval rt 'Co--t; or*on”a*sampled function 2S’ sin =the 
latter case, the correlation integral is usually ex- 


pressed by a sum: 


Cra rarer bt tense) (2) 
t 


where At is the Sampling interval. This definition re- 
quires that the displacement only occur as an integral 
Sele apic of the sampling interval. 

Two different correlation operations can be iden- 
tisnedad Bina itpondab (&).anes dentuca li i.e. Lt .aeb).,; 
an autocorrelation function is obtained by application 
of Equation 1. Thus autocorrelation indicates whether ~ 
coherence exists within a signal. In contrast, a cross- 
correlation function, producedsi £4 a\.t).ande)(t) are 
different, shows the similarities between two signals. 

To,,illustrate. the, process,.of correlation 


consider the autocorrelation of a Sine wave as shown in 
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Figure la. In the first frame the sine wave is multi- 
plied by Ltself in’ phase, a.e. 1=0°. The.result as 
illustrated is a Sime wave. To complete the evalua- 
tron Or the autocorrelation function at this relative 


Z wave must 


displacement the average value of the Sine 
be determined (see Equation 1). The dashed line indi- 
cates this value. This first point of the autocorrela- 
tion is plotted in the lower part of Figure la and 
represents the mean square value of the original sine 
wave. 

In the successive frames of Figure la the evalu- 
@tzon Of the autocorrelation function at t values of 
We eeboo-) nde 20 tes Iu luSstrated. se romy the plotiof 
the autocorrelation function Cas in Figure la it should 
be apparent that the autocorrelation operation applied 
to any Sinusoidal wave of indeterminate phase converts 
it to a cosine wave. Thus phase information contained 
in the original sine wave is lost. However, the ampli- 
tude and frequency (or period) of the autocorrelation 
function are unambiguously related to those of the 
original sine wave. The period of the two are identi- 
cal while the amplitude of the autocorrelation function 
is the mean goats of the original sine wave. 

The autocorrelation function of any periodic 
waveform will display. similar chereererictics Since any 


such waveform, as can be shown by Fourier analysis, is 
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Figure 1]. (a). Autocorrelation of a sine wave.« (b)-Auto- 
correlation of a square wave. 


Py o 4 


yy 


7 nl il i: a 


i, > i ne < 
iy ee a Let 
i vee 


a aye i ir 


ee 


fee's ee Sr 
a -% TS eM Wt i yi 
Vsa9 ri ere an 


‘ y . ‘ - o 


rote nab ere site # Ya totsibsstooosuA (ch) A sepa 
| tw Spee Fh 26 ‘notsslexios | o) 


just a combination of a number of sine waves, each with 
its own amplitude and phase characteristics. But, as 
mentioned above, although frequency and amplitude in- 
formation about the original waveform is carried in the 
autocorrelation function, the phase information in the 
Original signal is lost. This fact is emphasized by 
the autocorrelation function of a square wave generated 
as shown in Figure lb. The triangle wave autocorrela- 
tion function contains the same frequencies (i.e. sine 
wave components) as the original Square wave, however, 
in the triangular wave all the sine wave components are 
in phase at t=0° and produce a different summation wave 
shape. 

Autocorrelation of non-periodic or random (noise) 
waveforms produces markedly different results from 
those obtained for periodic waves. To understand this, 
we need only recognize again that any wave, whether 
periodic or not, is composed of sine wave components. 
Each of these components, when autocorrelated, will pro- 
duce a cosine wave beginning at T=0. When many such 
components are present in a parent waveform, the re- 
sulting autocorrelationtwidilygustibe the.sum ofethe 
autocorrelationutunctions? Off the, components..«Four. such 
autocorrelation images are shown in Figure 2a. A true 
random waveform (white noise) contains all frequencies. 
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Figure 2. (a) Cosine autocorrelation images. (b) Auto- 
correlation function of ideal random noise. 
(cl PAutocorrelation functronlof *bandlimited 
random noise. (djeAutocorre lation: 2unction, of 
a noisy sine wave. 


iis ul ey, hy NR Raced vie mn ; , io.) { 
as ee iol ie t ne Ei 


it, en i ma \ pa chy Te ( ‘% 


m Vg ‘a 
We atta \ 
‘ : 1 

4 

v9 bape i 

. i 

7 ; . 


“a a ~Og¢bk (a) “eobrmi- ote sl ovzoso9ue a.iaeo (a). + cgay n 
eq moiast ieehi 10 dorionnt ng lasionsm ‘a 
i ROEEY oennar to" notion? ASAP LSUIossIyA “tp ae 


46 aoktonut adtsederros0s3 ys Ab) .@adon magne: 
1SV5wW Sake Yeior s 


cies reinforce at t=0 to produce a value equal to the 
mean square of the original random signal. and at any 
point beyond t=0 they destructively interfere to pro- 
duce a time averaged value of zero (see Figure 2b). 

in Order-co obtain this, 1deal autocorrelation 
function of random noise, the bandwidth of the noise 
must be infinite. Of course, no process in nature is 
truly random. Real random waveforms are "band-limited" 
and do not produce a Single spike upon autocorrelation 
but instead a shape such as portrayed in Figure 2c. 
The functional form is a decaying exponential (for low 
pass filtered random noise) whose width is inversely 
proportional to the bandwidth of the noise waveform. 

When the autocorrelation functions of bandlimited 
random noise (Figure 2c) and of periodic signals (Figure 
1) are compared it is clear how autocorrelation can be 
a powerful technique for the extraction of periodic 
Signals from noise. Random noise contributes to the 
autocorrelation function only at very small values of Ts 
Aeperiodic Signal, in. Contrast, wilt, continues toscen> 
tribute even at very large values of tT. The auto- 
correlation function of a noisy Sinusoid is shown in 
Figure 2d. The amplitude and. frequency of the periodic 
signal buried in noise can be determined simply by 
examining the autocorrelation function at a location 


well removed from the central (t=0) peak. These points 
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will be further discussed in Chapter III. 


Cross-Correlation 

In contrast to autocorrelation, cross-correlation 
examines the coherence between two different signals. 
This coherence can Only exist when the same frequencies 
are present in both waveforms. For example, the cross- 
correlation of a Sine wave with a square wave of the 
same frequency produces an output Sine wave since the 
fundamental frequency of the square wave is the only one 
that is common to both. Furthermore, although an auto- 
correlation is symmetrical about t=0 and shows a maxi- — 
mum at that point, a cross-correlation is generally 
asymmetrical and does not necessarily maximize at tT=0: 
in the example given of a Sine wave and a Square wave 
the phase angle of the output Sine wave depends on the 
phase difference between the two inputs. The behaviour 
of the cross-correlation function is also different if 
the inputs contain random noise. The cross-correlation 
of two different random signals is itself random and will 
therefore have a zero time average. Hence, it may ons 
be necessary to displace the two inputs to obtain an 
output to een noise does not contribute, as long as 
the two input frequencies are in phase; i.e. scanning 
may not be necessary. 


A further advantage of cross-correlation over 
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autocorrelation is that the output amplitude is 
dependent upon the amplitudes of two different signals, 
and thus can be adjusted merely by adjusting the ampli- 
BuaevOs. One Of Ehe-1nputs. (lf the-amplitude of this 
reference waveform is maintained constant, the ampli- 
tude of the output signal will be linearly dependent on 
the amplitude of the other sought-for input, in contrast 
to autocorrelation where a squared dependence of output 
amplitude to input must exist. Of course, it is now 
necessary to generate the reference waveform by some 
means. 

Further examples of cross-correlation will be 


given an Chapters In, 2V,, ana Vi.« 


Convolution 

The points that have been introduced are some- 
times more well known under the heading of convolution. 
However, convolution, which occurs during any opera- 
tion involving Signal generation or measurement, can be 
considered as merely a special type of correlation. 


The mathematical expression of convolution is 


. +o 
Con, (t) = aE a(t) bieLet ) Gtanel erm (3) 
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Comparison of (3) and (1) shows that the only difference 
between correlation and convolution is the appearance 

Ce a minus. Sign betore: the t in the b functions je. 
this function is inverted left-to-right before the 
multiplication is performed. An example ot -thas inver- 
sion can be seen in Figure 3 (from Reference 3). Ifa 
step function is applied to an instrument such as a 
chart recorder which has a response function that is an 
exponential decay, the recorder output will be observed 
to be distorted by the instrument. Application of the 
correlation integral to the system yields an output step 
function whose leading edge curves upward. We know that 
recorders do not respond in this way to step input 
Signals; rather, the leading edge must curve downwards. 
Reversing the recorder response function, i.e. perform- 
ing a convolution rather’ than a correlation, produces 
the desired output, form. “Of course, 1f the instrument 
response function was symmetrical, correlation and con- 


volution would produce identical results. 


Fourier Transformation 

SB rinal sctopre Intimately) related tovcorrelation 
and Bors NeLon is Fourier transformation. The advent 
of the digital computer and the Fast Fourier Transform 
(FFT) has allowed the ready implementation oF Fourier 


transform approaches to data processing. It can be 
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Figure 3. Convolution and correlation of a step waveform 
with an exponential instrument response function. 
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shown that the correlation of two functions a and b is 
equivalent to the multiplication of the Fourier trans- 
forms of the functions and inverse transformation of 

the result to give the correlogram.  *Sehematically, this 


can be represented as 


a(t) * bitin =pterets) (4) 
Fourier Taverse 
Transformation ES ens : 
Transformation 
ACE) X Bh), = Cap (£) 5) 


The asterisk in Equation 4 is here used to represent the 
Operation Of correlation; Equation 4 is therefore simply 
a shorthand notation of Equation 1. 

Since correlation and Fourier transformation are 
SQ intimately related, it 2s instructive to consider 
the Fourier process in more detail. The basic equation 


as 
+ 00 ' 
a(t) = i Aeeo ee ae (6) 


The inverse Fourier transform is 


+ co 
A(f) = | ae ee eS (7 


= & 


Functions a(t) and A(f) therefore constitute a Fourier 
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transform pair, and are equivalent representations of 
eachother.) Lf the’ function a(t) is a linear function 
of time, as are many chemical signals (chart recorder 
GUEpUL, etc.), then the Fourier transform A(f£) will be 

a linear function of frequency, time +, - This particular 
use of the term frequency should be distinguished from 
that normally encountered in optical spectroscopy; for 
that reason, the function A(f) will generally be re- 
ferred to here as the Fourier domain signal. 

An interesting property of the Fourier trans- 
formation is that functions of complex appearance in the 
time domain often appear remarkably simple in the Fourier 
domain, and vice-versa. For this reason, it is often 
useful to consider the Fourier domain representation of 


a function, as willbe shown in Chapters V and VI. 


Correlation Instrumentation 

A block diagram of an instrument that performs a 
direct implementation of the correlation equation 
(Equation 1) is shown in Figure 4. The inputs to the 
correlation tare™a Signal (function! a of Equation) 1) and 
a reference (flinction b of Equation 1). Often; the 
reference must undergo some type of processing (such as 
{ Variation) and might even be stored inthe reference 


processor, which may be quite complex. The signal and 


processed reference are multiplied and then integrated 
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to give the output correlation function (C Ole bQuatroir 1) i 
The integrator of the hardware correlator may also have 
to be quite complex. It may also be necessary to have 
a Signal processor (dotted in Figure 4). This block 
diagram may represent both a hardware correlator, in 
which case the reference processor might be a phase 
shifter and comparator (see Chapter II) and the signal 
processor a tuned amplifier; or a software correlator, 
in which case the reference and signal processors might 
be A/D converters and a digital computer would perform 
the shifting, multiplication, and integration opera- 
tions. The functions a and b might be identical, in 
which case an autocorrelation would be performed (see 
Chapcer sli 1), 

In this thesis, we will examine several ways of 
implementing Equation 1 by instruments that perform 
the functions "diagrammed in, Figure 4.) “In Chapter Ii, fa 
versatile lock-in amplifier will be discussed in which 
the realization of Figure 4 is very simple. In Chapter 
III, an autocorrelator based on a Serial Analog Memory — 
(SAM) which acts as a temporary storage device will be 
discussed, in which the implementation of Figure 4 is 
extremely complex. In Chapter 1V, a. cross—-correlator 
based on a) transvent recorder that stores the reference 
signal (function b of Equation 1) will be aie ces a 


which the implementation of Figure 4 is also quite 
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complex. Chapter V will discuss the Fourier transform 
realization of Equation 1 by a digital computer; and 
Chapter VI will discuss the direct evaluation of Equation 
1 by a Tapped Analog Delay Line (TAD), which allows the 
enplementation*or Frqure 4 *in ~an”extremely simple but 
powerful way. Applications to be discussed in this 
thesis include signal-to-noise ratio enhancement, 

matched filtering, and resolution enhancement as applied 


to spectral signals. 


CHAPTER II 


LOCK-IN AMPLIFICATION 


Background 

One of the simplest, yet most powerful, instru- 
ments based on the principle of CORTetn aon is the lock- 
in amplifier (9), which is one of the most common and 
effective instruments used in the chemical laboratory 
for the measurement of noisy signals (5, 10-14). A 
measurement in which a lock-in amplifier is utilized 
involves three main operations: amplitude modulation 
of a carrier wave with the desired signal information, 
selective amplification and synchronous AM demodulation. 
The amplitude modulation step is implemented at some 
specific point in the experimental system and the lock- 
in anpiifier carries out only the last two steps. 

The key step in a lock-in amplifier measurement 
and that step which gives the technique its name is 
synchronous AM demodulation (10). Synchronous demodula- 
tion involves multiplication of the modulated carrier 
wave by a reference signal of exactly the same frequency 
as the carrier wave and phase-locked to the carrier wave 
at 0° phase ‘shift, .Demodulation is completed by 
averaging the output of the multiplication step, usually 
with a low-pass filter. Lock-in amplification is thus 


essentially a cross-correlation at tT=0, since it involves 
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the operations of multiplication and integration. 

A block diagram of a conventional lock-in amplifier 
is shown in Figure 5a. Two channels are normally pro- 
vided, one to process the signal (amplitude modulated 
carrier) and one to process the reference. In almost 
all lock-in amplifier measurement systems, the phase 
locked reference signal is generated at the amplitude 
modulation step in the experimental system. For example, 
in systems where modulation is implemented by chopping 
a primary light beam with a mechanical chopper, a ref- 
erence signal can be obtained by using an auxiliary 
light source and detector combination or from the signal 
used to drive the chopper. The reference signal as 
generated at the modulation step is phase-locked to the 
Carrier frequency but, it,is not, in general, locked 
at 0°. Thus a phase shifter is required on the reference 
channel in order that the relative phase of the ref- 
erence can be adjusted with respect to the carrier. 

This phase shifter performs the T variation of the cross- 
correlation process. The comparator in the reference 
channel converts the reference to a bipolar square wave 
before it is applied to the four quadrant multiplier. 
Selective or tuned amplifiers are also normally in- 
cluded on each channel. 

The conventional design of the lock-in ane T eter 


(Figure 5a) can be enhanced and simplified with a 
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SIGNAL ‘ SELEGHIVE 
FILTER E—> OUTPUT 


INPUT AMPLIFIER 
ae 


REFERENCE »| SELECTIVE 
INPUT AMPLIFIER § 
SIGNAL SELECTIVE PI antec? ORAM ae Cel ER ea 
INPUT AMPLIFIER FILTER 
lB atsed, 
r SEHDSLLS Snes 
REFERENCE_ ~~ s| PHASE: (2 
INPUT SHIFTER 
Figure 5. Block diagram of a lock-in amplifier, (a) conven- 


tional approach, (b) with a phase locked loop in 
the reference channel. 
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versatile circuit known as a phase-locked loop (107. 15, 
16). A block diagram of a phase-locked loop (PLL) is 
shown in Figure 6. It consists of three main parts; a 
phase comparator, a low pass filter, and a voltage con- 
trolled oscillator (VCO). A number of types of phase- 
locked loops are available from several manufacturers. 
Among these are the Signetics 561, 562, and 565 PLL's 
ancaurcn, S CD4046 PL,’ all of which’ are’ available in “I6 
or 14 lead dual-in-line packages at very reasonable 
costs’&(=S10.200) . 

In the basic PLL as shown in Figure 6, the phase 
comparator compares the phase and frequency of the in-. 
put frequency with the VCO output and generates an 
error voltage proportional in sign and magnitude to the 
phase and frequency difference of the input frequency 
and the VCO output. This error signal is applied 
through a low pass filter to the VCO control input and 
drives the VCO output until the VEO output is exactly 
the same frequency as the input frequency; i.e., the VCO 
output becomes locked to the input frequency. The rela- 
tive phase difference between the input frequency and 
the VCO output when the loop is locked depends on the 
exact nature of the phase comparator and, in general, on 
the value of thesanput. frequency with respect (to the 
free running VCO frequency. In some amr raee oul PLL's 


(RCA CD 4046) the circuit can be set up so that the phase 
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Block diagram of a phase locked loop. 
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difference is a constant 0° in the lock range, independent 
of the value of the input frequency. With most others, 
the phase difference varies anywhere from 0° to 180° 

over the lock range. 

The common, applications of the PLL include FM de- 
modulation, frequency multiplication and construction of 
eracking filters. In connection with lock-in amplifiers, 
the standard PLL can be usefully incorporated into the 
reference channel. As shown in Figure 5b, both the 
selective amplifier and the comparator can be replaced 
by a PLL. In addition to replacing these components, 
eae FL provides automatic tracking Of the carrier 
frequency. For this feature the PLL must be of the type 
that maintains lock at 0° phase shift over the lock 
fange. The phase shitter block is still necessary ibe- 
cause the reference, as generated at the modulation 
step in the experiment, is seldom exactly in phase with 
the carrier-wave. “In-addition, yelative phase shifts are 
easily introduced in the signal amplification channel 
before the four quadrant multiplier. 

The Signetics 561 phase locked loop is a uniquely 
versatile circuit element for application to lock—in 
amplifier He ee The 561 includes, in addition 
fova PL, a multiplier and a) low pass, filter which can 
be used for synchronous AM demodulation applications. 


Thus this simple 16 pin integrated circuit contains al- 
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most all of the function blocks of a lock-in amplifier. 
A block diagram of the 561 PLL is shown in Figure 7. In 
its simplest configuration the only additional circuit 
block needed to build a complete lock-in amplifier is a 
phase shifter injthe reference channel. = 

The standard lock-in amplifier as used in scien- 
tific measurements normally has separate signal and 
reference channel inputs. However, the utilization of 
a phase locked loop in the reference channel allows an 
interesting modification of this standard approach. 
The phase locked loop can be used to generate an appropri- 
ate reference Signal for synchronous AM demodulation 
from the amplitude modulated carrier wave. This is 
accomplished by connecting the signal (amplitude modulated 
carrier) to both the signal and reference channels as 
shown by the dashed line in Figures 5b and 7. The VCO 
Output of the PLL is a square wave, phase locked to the 
signal, and hence an appropriate reference for synchronous 
AM demodulation. This removes the need to generate 
a reference signal at the modulation step and the need 
to transmit the reference from the experiment to the 
lock-in amplifier. A fundamental limitation of this 
approach is that a double sideband modulated carrier (1)) 
Cannot be accurately demodulated as phase information 


will) bellost in: demodulating such avcarrier with a irefi- 
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erence Signal generated from itself. However, in the 
vast majority of lock-in amplifier measurements, AM 
modulation is employed and no difficulties will be en- 
countered using this approach. 

In the following sections the performance and 
characteristics of lock-in amplifiers based on Figures 
©) andedsare discussed and illustrated. The amplifiers 
are tested both in the "referenceless" mode and with 


separate signal and reference channel inputs. 


Experimental 

All circuits were wired on the Heath Analog- 
Digital Designer (ADD). The operational amplifiers 
used were the standard units provided with the ADD unit. 
The lock-in amplifier based on the 565 PLL requires 
an external four quadrant multiplier. An Analog Devices 
426A four quadrant multiplier was used for this purpose 
($45.00). 

The input test signals were provided by a Heath > 
model EUW-27 sine-square wave generator (SSWG) and a 
General Radio Type 1390-B Random Noise Generator was 
used as the source of the noise. The random noise had 
a bandwidth’ extending from 20 Hz to 20 kHz. Noisy 
signals were simulated by summing the sine wave Signal 
from the SSWG and the output of noise generator with 


an operational amplifier. 
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AC measurements of the input values were made 
using a Hewlett Packard Model 400EL AC voltmeter, and 
output dc levels from the lock-in amplifier were measured 
using a DANA Model 5400/015 DVM. The DANA is a succes- 
Sive approximation type DVM with a sample and hold front 
end. The aperture time of the sample and hold amplifier 


mS .5O0 nsec. 


Results and Discussion 

As mentioned in the introduction, the Signetics 
561 phase locked loop integrated circuit incorporates 
essentially all of the functional blocks necessary for 
a lock-in amplifier. The complete circuit for a lock- 
in amplifier constructed using the Signetics NE 561 phase 
focked loop is)showhjiin Pigure 8. Tt .consists. .om™etour. 
main sections; a tuned input amplifier on the signal 
channel (OAl1), a phase shifter on the reference channel 
(OA2), the 561 PLL, and a low pass filter on the output 
(OAS). The -tunéedfamplifier ongthe, signal channe)) (10) 
has a nominal center frequency of 1000 Hz, a Q of about 
2,5) and vanity gains . The phasemshitter “(37),on@the 
reference channel provides a Variable sphase shift of up 
Eo. Le0 sewer tunity. gain. 

Complete details on the operation of the 561 PLL 
are available from Signetics. . Only ethose aohaeacions 


pertinent to this application will be discussed. Also 
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Perwili "be Useful ‘to refer to Figure 8 during this ‘dis- 
cussion. The 0.5 yf capacitor between pins 2 and 3 sets 
the VCO free running frequency. This value was chosen 
to give a nominal free running frequency of 1000 Hz. 
Pin 13 is the input to the phase comparator and thus is 
the reference channel input to the PLL. The 50 wf capa- 
citors and 47 Q resistors connected to pins 15 and 14 
control the amount of low pass filtering in the phase 
locked loop. The potentiometer connected to pin 11 is 
an offset adjustment with which the phase of the VCO 
frequency can be adjusted relative to the input reference 
frequency. Both this offset control and the phase 
shifter (OA2) were used to set the 0° phase shift condi- 
tion between the signal and reference channels. The 
Capacitors connected to pins 16, 12, and 10 simply provide 
ac grounds and decoupling at these terminals. 

The AM input to the multiplier on the chip is 
pene 4h andsthus this is the siqnal channel input.) Pin 1 
fe the demodulated AM Output. This Output can be pas- — 
sively low pass filtered by connecting a capacitor from 
pin 1 to ground. However, we choose to use an external 
active low pass filter "with a 1 sec time constant (0A3). 
Thevoutpuc dc level at pin’ las about 710.5. V when no “in- 
put signal is applied at pin 4; thus some form of zero 
adjustment on the output is desirable. This is pro- 


vided by the potentiometer connected to OA3. 
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The input tuned amplifier and the output low pass 
filter on the signal channel were both set for unity gain. 
Bauseiny this, cest:-carcuit the. only. gain in the siranal 
channel is that provided by the PLL. The gain was about 
25 Calculated on the! basis of the average dc level of 
the demodulated AM output divided by the rms value of the 
input sine wave. This limits the maximum input signal 
to about 80 mV before the multiplier on the 561 begins 
tO saturate. 

The lock-in amplifier shown in Figure 8 was first 
tested with separate signal and reference channels. The 
input Signal was a sine wave obtained from the sine- 
square wave generator. The square wave output of the . 
SSWG was used as the reference. Reliable locking could 
easily be achieved with a reference signal as small as 
l mv p-p. The minimum input signal to the phase com- 
parator for lock, as specified by the manufacturer, is 
100 uv. 

The linearity and dynamic range of the lock-in 
amplifier in this configuration were evaluated by measur- 
ing the slope of the log-log plot of output vs input. 

The slopes of these plots for different noise levels are 
summarized fe Table IA and all are very close to unity. 
For a 4.36 mV rms Sine wave input the AM demodulated out- 
put was 111 + 8 mv when 160 mv rms of Pandca noise was 


added to the sine wave and 112 + 18 mv when 500 mv was 
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31 
TABLE I 
Lock-In Amplifier Linearity and Dynamic Range 


(Separate Signal and Reference Channels) 


A. For the circuit shown in Figure 8 


Input Signal Order of Slope of Log-Log 

Range Magnitude Noise Level Plot. Tom Output 
(mV, rms) Change (mV, rms) vs Input 
72 SONS aos OY BE a: > residual dO Role Peek AOE: 
4.36 - 43.6 20 residual 1203 7+ SO 00G 
a0 43.6 tre) 160 TO LG e000 
4.36 = 43.6 1.0 500 02.9. 78, s45 101002 


B. For the circuit shown in Figure 9 


2.45 “- 2450 3.0 residual 0 «992 F22 0.003 
Jai: sae 45,0 3:0 160 O 49:9 9ir290%00 2 
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present. The standard deviations were calculated from 

10 measurements of the output made with the DANA DVM. 

The time constant on the low pass filter was 1 sec. These 
@atalindicate) thatthe circuit is quite effective in 
enhancing the signal-to-noise ratio of the input signal. 

The cincuityfor a lock-in amplifier based on#@the 
block diagram given in Figure 5B is shown in Figure 9. 
The signal channel consists of a tuned amplifier (OAl1), 
a four quadrant multiplier, and a low pass filter (OA4). 
The reference channel consists of a phase shifter (OA2 and 
OA3) and a conventional phase locked loop IC (Signetics 
565) as depicted in Figure 6. The two stages of phase . 
shift simply provide a greater degree of flexibility in 
setting the phase as well as the capability of shifting 
the relative phase over a total of about 360°. 

Again complete details on the 565 PLL can be 
obtained strom|Signetics (16). The capacitor to ground 
from pin 9 and the resistance to’ +15 V from pin 8 set 
the free running frequency of the VCO which in this case 
was 1000) Hz. The.025 wh capacitor) from pin) 7 to 485 vo 
controls the loop low pass filtering and the 0.001 uf 
capacitor between pins 7 and 8 is for decoupling. Pins 
2 and 3 are the external inputs to the phase comparator 
and, hence, the reference input. The voltage divider 
network is necessary in order to bias pins 2 and “3 for 


proper operation of the chip from a single power Supply. 
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Pin 4 is the VCO output which is the phase locked reference 
Oucpuc to the four quadrant mattipliirer<y” “lt mustralso be 
ecmnecred Co pin 5, whiich*is the internal input tothe 
phase comparator, to close the loop. 

The only gain in this particular circuit occurs at 
the multiplier. The VCO output is a square wave with an 
amplitude “or about 5 Vs The*multiplier “output 1s ©xv/i0% 
This gain of 1/10 is counteracted by using an active low 
acs citcer which*nas*a gain of f0;=thus;, the-overalt 
Gait) OL the Signal ”channel “rs 5% 

The linearity and dynamic range of this lock-in 
amplifier was meaSured as described for the first circuit 
and the data are summarized in Table IB. It can be seen 
from the data that the lock-in amplifier has excellent 
linearity over a dynamic range of 3 orders in magnitude, 
even in the presence of a considerable amount of noise. 
The improved dynamic range over the previous circuit 
occurs primarily because the external four quadrant 
multiplier has better dynamic range than the on-chip 
mottrolrer Of the o6l"eLo. ine stgndal-ctO molee rato 
improvement was also excellent. For a 7.7 mV rms sine 
wave input buried in 500 mV rms of random noise (20 Hz 
to 20 kHz bandwidth) the output dc level was 37 + 4 mV, 
the standard deviation again being calculated from 10 


measurements. 


Both of the lock-in amplifier circuits were also 
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tested in the "referenceless" mode discussed earlier. 

In this case, the reference input was obtained from the 
Signal channel as shown by the dashed line in Figures 
Seand, 9. "The ability of the PLL's to lock on a low level 
Signal is an important asset for this application. The 
linearity and dynamic range data were measured as be- 
fore and the results are shown in Figure 10a for the lock- 
in amplifier given in Figure 8 and in Figure 10b for the 
amplifier in Figure 9. In both cases (solid line) the 
"referenceless" configuration works essentially as well 
as the conventional configuration for the residual noise 
case. The least squares slopes for the solid lines in 
Pxonres, LOatand #Ob are 1.007: 40.01; and 1.02 4 0.0L; 

At high noise levels, the linear dynamic range is 
reduced because the loop cannot lock as effectively on 
the noisy reference. The phase adjustment on a lock-in 
amplifier is set to maximize the AM demodulated output. 
Any jitter of the optimal phase position as caused by 
the noise will decrease the output signal as shown in 
Figure 10. However, even though the linear dynamic 
range of these "referenceless" configurations is peaaced 
at low signal-to-noise ratios, the circuits can be used 
at moderate peas levels. For example the amplifier 
shown in Figure 9 has a linear response at signal levels 


greater than ~100 mV rms even in the presence of 500 mV 


rms random noise. In many practical measurement situations 
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Figure 10. 


Log- Log. plots Of) output ws anprertomiine 
"referenceless" configurations of the circuits 
given an Figure 38), (a) and “Btoqure 87h). ithe 
‘solid line is the residual noise case, the dashed 
line for 160 mv rms random noise present on the 


input signal and the dotted eas dash) line 
for 500 my, rms. 
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the noise levels are not this high and the "referenceless" 
mode of these lock-in amplifiers should be a viable and 
useful configuration. 

Finally, it is clear that a lock-in amplifier need 
not be considered an expensive component of a measure- 
ment system. As already mentioned, the PLL's used in 
these circuits costs about $10. Depending on the quality, 
analog multiplier prices range from about $10 for 4% 
Peciiracy, tO.abouc 550 for 1% accuracy. Thus, including 
the necessary OA's the circuits shown here can easily be 


built for about $50 to $100 excluding the power supply. 
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CHAPTER: TEL 


AUTOCORRELATION: THE SERIAL ANALOG MEMORY 


Background 

In the previous chapter, we saw how lock-in 
amplification is basically a single-point cross-correla- 
tion at t=O. It does, however, require that a reference 
Signal be available, or that the received signal be 
sufficiently noise free that it itself can be used to 
obtain the reference. Autocorrelation, on the other 
hand, has the fundamental advantage that a reference is 
not required. However, in the process of autocorrelation 
all phase information is lost, and the output is not a 
minear function of the input. 

One interesting application of autocorrelation 
has been in the meaSurement of the shot noise from a 
photomultiplier tube (18-22). Shot noise arises from the 
Guantum nature of light, and the amplitude of the noise 
current is proportional to the square root of the light 
intensity. Accordingly, the mean square of the shot 
noise current (shot noise power) should yield a plot 
that is directly proportional to light intensity. Shot 
noise power can be obtained by squaring the shot noise 
component of the AC coupled signal and low-pass-filtering 
the wesult, i.e...an autocorrelation at naOe Several 


workers have used this technique successfully to measure 
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photocurrents (18-22). 

Construction of a scanning autocorrelation, on the 
other hand, allows the extraction of more information 
than that available at only T=0O. The field of photon 
correlation spectroscopy involves the autocorrelation of 
the intensity fluctuations of a Doppler broadened Rayleigh 
scattered laser, line, (23-25)... The autocorrelation 
function of a signal is the Fourier transform of its 
power spectrum (23). Determination of an autocorrelogram 
can allow measurement of several flow-related parameters. 
Representative papers have dealt with such measurements 
as that of the diffusion coefficients and electrophoretic 
mobility of bovine serum albumin (26), a study of electro- 
kinetic phenomena (27, 28), and the determination of 
macromolecular diffusion coefficients (29). To achieve 
the speed required in these measurements (~20 MHz) the 
autocorrelation is often performed on a "digital clipped," 
fee obinary, <inputisignal (30551), . 

Another interesting use of autocorrelation in- 
volves the measurement of chemical kinetic parameters by 
Ehe Jautocorrelationuwof theynoisesdueyto, random concentra- 
tion fluctuations of reactants and products involved 
inc hemical equilibria. Concentration fluctuations can 
be measured by such techniques as conductivity and fluo- 
rescence intensity (32, 33) and kinetic Seer then 


deduced from the autocorrelogram. In the words of Feher 
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and Weissman (32), the result involves "the personal 
Satisfaction of using rather than fighting noise." 

Although autocorrelation techniques have been 
employed in these and other fields with considerable 
advantage and success, their use has unfortunately been 
somewhat limited primarily by a lack of effective methods 
and instrumentation for the rapid, automatic evaluation 
of autocorrelation functions. Present developments in 
certain large scale integrated circuits such as diode 
arrays, charge coupled devices, and bucket brigade devices 
are now beginning to provide very inexpensive devices 
capable of sophisticated real time correlation operations 
(34). These integrated circuits can be generally clas- 
sified as discrete time analog signal processing devices. 
One such device is a serial analog memory (35). When 
Operated as a variable analog delay line it allows real 
time autocorrelation processing of noisy periodic 
signals, and the real time evaluation of autocorrelation 
functions “suchas thosé’ depicted"in Figures lvand’2. ®The 
key circuit element is a serial analog memory that is 


operated as a variable analog delay line. 


Serial Analog Memories 
A few years ago self-scanning linear photodiode 
arrays became available in small integrated circuit pack- 


ages. These devices have been widely used as electronic 
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image sensors in industrial and scientific applications 
moves) «| These sensors consist; of a linear array of 
silicon photodiodes. Each photodiode is connected to 
the output line by a FET switch. The FET switches are 
controlled by a single bit that is shifted through a 
shift register that is integrated on the same chip. 

Functionally the self-scanning linear array of 
photodiodes can be considered as an analog shift register 
with parallel optical inputs and a serial electrical out- 
put. Diode array devices are now available with serial 
electrical input and output. A wide variety of power- 
ful real time analog data handling and processing 
operations can be implemented with these devices (34). 

One type of device, available from Reticon Corp., 
910 Benicia Ave., Sunnyvale, CA 94086, is called a 
serial analog memory (SAM) (35). A block diagram of a 
SAM-128V serial analog memory is shown in Figure ll. The 
SAM consists of three basic subunits: a "dynamic" 128 
point serial analog memory, a readin 128 bit digital shift 
register, and an independent readout 128 bit digital 
shift register. The complete SAM-128V comes in a single 
16 pin integrated circuit package. The maximum clocking 
rate is specified at 5 MHz, S/N at 40 dB (1 part in 100), 
and total harmonic’ distortion at) 3.5%. 

With the SAM an analog input signal can be sequen- 


tially sampled and stored on a series of storage capacitors. 
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Both aperture and acquisition times are specified at 25 
nsec. The stored signal values can be read out in 
sequence either immediately, or after some delay. The 
readout rate can be the same as the readin rate or the 
Signal can be read out with a new time base and, hence, 
either compressed of Eee Each memory capacitor 
(reversed biased PN junction) has a FET buffer stage, 
thus readout is non-destructive. However, with this 
device the retention time without degradation (because 
Of leakage, i.e. "dark" current) is 40 msec at room 
temperature. Thus the memory is really a "dynamic" 
memory requiring periodic refreshing. A more recent 
version of the SAM has a retention time of 5 sec. 

The serial analog memory is potentially an ex- 
tremely powerful circuit element for incorporation into 
correlation instrumentation. For example, this single 
integrated circuit, with appropriate clocking circuitry, 
can function as a transient recorder. Many types of 
hardware correlators utilize transient recorders, as 
will be shown in Chapter IV. In addition, this particular 
serial analog memory possesses some features that make 
it uniquely applicable to binary sequence correlation. 
Readout, aS mentioned above, is controlled by the read- 
Saiiais hdetiees ec sitter. ® «lf alsbit fexistsS, intithe wWeh itage, 
Pheenthwceil wid lebe zeadliout. m@Phus; ifijai specific binary 


sequence is clocked into the readout shift register, the 
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output will be the summation of the products of the 
binary sequence and the stored analog information.» Thus, 
this application amounts to the rapid cross-correlation 
of a stored analog signal with a moving sequence of 
binary pulses. Such correlations are applicable to 
pattern detection. 

In this chapter, we will discuss the application of 
the SAM to the design and construction of an autocorrela- 
tor. A block diagram of the autocorrelator is shown in 
Figure 12. The input signal to be autocorrelated is 
sent simultaneously to the serial analog memory, and to 
one input of an analog multiplier. The output of the 
serial analog memory is connected to the second input of 
the analog multiplier. The output of the analog multi- 
plier is integrated to complete the autocorrelation. 

The serial analog memory is operated functionally 
aS a variable analog delay line. The readin and readout 
clock rates are identical but the readout cycle is 
sequentially delayed, providing the shifting operation 
necessary in the evaluation of the autocorrelation func- 
tion. It is important—to: emphasize that with the archi- 
tecture of the SAM it is possible to have gero delay, 
i.e. readout simultaneous with readin, as well as any 
Other delay in units of clock period. Thus the serial 
analog memory is not simply an analog shift register. 


In a true shift register zero delay cannot be achieved, 
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as the first sample must be clocked completely through 
the register before it can be readout. Conventional 
transient recorders based on ADC's, digital shift regis- 
ters, and DAC's, and another circuit manufactured by 
Reticon called a serial analog delay (SAD) both have 
this limitation and, hence, could not be used in this 


autocorrelator design. 


Experimental 

The complete block diagram of the autocorrelator 
is shown in Figure 13. It should be noted that the 
SAM-128V was mounted on an SC-128V evaluation circuit 
card available from Reticon. The input and output lines 
shown on the block diagram are those of this circuit 
card. The card contains TTL to MOS interfaces and gener- 
ates the proper two phase clocks necessary for the 
readin and readout shift registers. 

To properly sample a repetitive analog signal 
with the SAM it was necessary to synchronize data aquisi- 
tron, ise. clocking, with*an externalsstart pulseiwhich 
Was, in general, asynchronous to the SAM clock. The 
master clock frequency was four times that of the readin 
and readout clock; therefore the maximum jitter of the 
SAM clock with respect to the signal start was one-quarter 


Of the Ciock period. 


Reception of the external start pulse started the 
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Figure 13. Block diagram of the autocorrelator. 


47 


dir : i orf i if ae 
i ; Hetty a 


‘ rl 
edit oie a uel ~ 


2 


" gediiabo wie its be) sce oti 


48 


readin and readout clocks and caused a readin bit tobe 
loaded into the SAM, thereby initiating data acquisition. 
The generation of the readout sequence was controlled 
Dy the; modulo-~ 128 ecounter.. At) T=0.,(no,.delay).,, this: counter 
was set to 127 and thus the first clock pulse towthis 
counter loaded a readout bit, thereby clocking data out 
of the SAM simultaneously with its acquisition. After 128 
clock pulses, the clock to the modulo 128 counter was 
shut off and a pulse applied to the scaler. After a total 
of 260 clock pulses, the readin-readout clock was shut 
down and another start pulse awaited. 

Scanning was accomplished by the scaler and re- 
set control. After a selectable number of scans as set 
byuyches~modulus ofthe scaler, (1ito,1000),, the scaler 
triggers the reset control, which quickly resets the 
eounteratorzero,.on ithe -count-of, two, diving awcount 
Secvence,Otel: ilyt (2) ¢+e0n4 by tc; Bosiears | where Lore .4when 
the 128 clock pulses to the modulo 128 counter were 
terminatked,athe.countersheld-ascounto£ 125,instead of 
thes,oniginakyl27. mThus, )whensthe next udata acquisition 
sequence began, a readout bit was not loaded into the 
SAM until two clock pulses after the readin bit, which 
introduces eee of two clock pulses in the readout of 
#he pdata.anin.this manner,,ansautomatic scan,of~the,delay 
(=) .fromezero to.126.,clock, pulses) in,steps ae two was 


accomplished, giving a total of 64 different delays. At 
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the maximum possible delay a minimum of 259 clock pulses 
were .CQulrea tovclear all circuitry. For some reason, 
perhaps associated with the SAM or the circuit card, it 
was not possible to successfully sequence the scanning 
action one clock pulse at a time and hence generate a 
128 point autocorrelation function. 

The delayed output was fed through a buffer 
amplifier referenced to the 5 volt common of the SAM and 
then to a four quadrant analog multiplier (Analog 
Devices 426A) whose other input was the original undelayed 
Signal. When a readout sequence was initiated integration 
was started on a gated integrator. This integration 
continued for the appropriate time interval, then the 
value of the integral was transferred to a sample-and- 
hold amplifier and the integrator was reset. A low-pass 
filter on the output of the sample-and-hold amplifier 
Suppressed switching transients and allowed averaging of 
a large number of repetitive evaluations of the cor- 
Telaction function ata. given delay (1 e. che scaleryset 
at modulo-1000). This allowed plotting of the auto- 
Correration function On an Ordinary Strip chart recorder 
For real time display of the autocorrelation function on 
an Oscilloscope the scaler was set to modulo-1. The 
Re fime Constant of the low pass filter for recorder 
output was ~0.1 sec and for oscilloscope output ~0.1 msec. 


Integration of the multiplier output was terminated 
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at the finish of either the readin cycle or the readout 
cycle, depending on whether or not the signal was periodic. 
For a Sine wave input the waveform arriving after the in- 
put has been sampled and stored has the same form as the 
section that was sampled. Thus integration can be 
initiated by the start readout pulse and terminated when 
the readout cycle is complete. However, for a more 
complex non-periodic waveform autocorrelation should only 
be performed where the delayed and original waveforms 
actually overlap in time. For such waveforms integra- 
tion is terminated by the completion of the readin cycle. 
The circuit is designed to operate in either of these 
modes. For example, if a Sine wave was autocorrelated 
aS a non-periodic waveform the autocorrelation function 
had the form of a damped cosine wave, its amplitude 
decreasing to almost zero where the signal and delayed 
Signal overlapped by only two clock pulses. 

A complete schematic of the autocorrelator is 
shown in Figure 14. The master clock gate is formed by 
EFI -FF2, and FF3: fAssume! that jO of FPlvis 0, ae, 
BRPinhas been reset... This sets FF2, andj resets FF’s 3.04, Ss, 
and the first (upper) modulo 128 counter. | The arrival 
ofa ee pulse will then toggle FF1, this freeing 
Pres) 2, 356-4-. 5 andthe, upper modulo a3 -counter«  “FPurveher 
start pulses cannot toggle FF1 (K=0) until the circuit has 


been rearmed. The first 170 transition of the master 
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clock will toggle FF2 to 0, thus toggling FF3 ($) from 
G»to~l. Once freed, FF2’ and  FF3 simply ‘divide the master 
erocr frequency *by* four. “"The™input “start "pulse generator 
ms Lormed by FF49~ “The first 1+0 "of ¥ "togglés’ Fra “to «Ll: 
Subsequent ‘transitions ‘are ignored (K=0). “Thus; 0 Or 
er47is 0 for one and“only “one 0>lF*transition-“of ¢, and 
therefore loads a single start bit. 

The output start pulse generator is formed by 
Bes 7 and “8 and *G5)°“FF's 7 and“8 forma “shift register 
that transfers Qing of the second (lower) modulo 128 
counter. Assume that FF's 7 and 8 are initially both 
0, and that the lower modulo 128 counter has been set to 


ae ener first O07 transition of’) wll tbe™ inverted ‘by 


FF5 | 
welbebe presented "to Kot «FF7. "Tne next “l-0 at “o'“will 


Gl ( =]1) and will therefore toggle Q108 to’ 0} which 
Loggia "Pry “tonal, Making ae OUEDUE Of Gb. "a 100" A further 
70 ato will "now toggle FFS to’ kremaking tthe output of 
Goea +l. Otherefore, “the*output of Gb as “also 0"for one 
and “only “one “0-1"*transition ‘of; “and ‘only “one readout 
bit is loaded. Note, however, that if the lower counter 
hasbeen set to 1277 the readout bre will -be "loaded 
exactly one clock pulse later than the readin bit; this 
por twalieebe referred bo’ Tater ry tne 071 "transi Cromer 
at the 64th 071 of ¢ will be reflected in 0's at 


Q128 
both ER/*andFPrs on the 65th leo. 


The! 128) pulsewgate. fs ‘formed ™ by the upper 
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moaguleo-h28cecounterforPF5, and Gl. ‘The 128th 150 transi- 
tion of @ toggles Q128 and: thus sBrs closing Gl 2% Wi tawas 
necessary tO operate ‘the twotmodulo 128 “counters*on 
Opposite clock phases to avoid timing problems associated 
witch ithisclosure.. Once toggléd tol, FF5 was locked 
(K=0) but FF6 was freed (J=l1). Assume that FF6 is 
Geiginalty nO so rThet25 6th p1+0 cof “¢ will ctoggle Q129 of the 
upper modulo-128 counter for the second time, thus 
Eoggling 4FE6 ‘to ‘lie The 260th clock pulse’ toggles Q, OL 
the upper modulo-128 counter to 1; this causes the 
OuwVePuc FOL IG2 "to the -zexo until FFe Qs wesét.” In *the 
AUTOMATIC mode, the momentary 0 from G2 will also reset 
Pyiy ChrougivGs and “G4, thus shuttingVof£f ¢ and *restart-— 
ing the operating sequence. Therefore, the upper modulo- 
28 ccounter, FF5, tand FFG? form thexmodwilo=260) -counter. 
Scanning isnconurGlMlied: iby tthesscaler ,. Say 
BeorsianadlG/ Af Assume that Frowas onlginaliys0wetihe 0 
Eranrsitionsuof Q128 of the lower modulo-128 counter are 
inverted and counted by the scaler. With Sl in the 
Dosatonmtshown! (25) if ieach W2720Ncf the Wowerm-countere will 


toggle FF9 to 1. Two clock pulses later, Q, will be a 


IMP rausingiithe, outputier Gir tombe zerotin GRIP he oe asi reset. 


This momentary zero resets the lower counter and causes 
the count sequence already described. Connecting the 
iMOwe Oo LAGE co Qy rather than Q, will cause the counter 


to scan one clock pulse at a time; however, the SAM could 
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not be made to so scan. 

The scanning action may be started with t=0 by 
Setting FF10. When FF1l is reset and a trigger pulse 
awaited, the output of G6 will be 0, thus setting the 
lower counter to 127 and resetting the scaler. The 
toggling of FFl1 by a trigger pulse will then toggle FF10 
to 0 thus making the output of G6 a 1 and freeing both 
the lower counter and the scaler. FF10 will then re- 
main in the 0 state (J=0) until set again. 

Integration of the product of the original and de- 
layed signals is controlled by Mono-1, Mono-2, and FF's 
Pie 2, 2anas. shenaAssume FFI2Z (as inatiallyianethesiastate. 
The initiation of the readout sequence at the 0-1 of 
G5 is inverted and used to toggle Mono-l. This sets 
Pe -sSilPvandereysthusiclosing Ql*dand sopeninged2 . nLOA2 then 
begins to integrate the multiplier output. Assume the 
circuit is in the PERIODIC mode. The appearance of a MOS 
1 level from Readout End one clock pulse before the 
termination ofreadout iseconvertedwto a TTLiezeroeand 
presented to J of FF12. The next 1-0 of @ signals the 
end+oridatatreadout andatogglesnPFizetor0.n) Thisstescts 
FFl11, opens Ql, and toggles Mono-2, thus connecting 
the integrator output to the sample-and-hold (0A3) 
through’ Q3. .After a*sample has been taken (~20° usec), 
Mono-2 toggles FF13, -thus closing Q2 and resetting he 


integrator. One, clock pulse after readout is terminated, 
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Readout End becomes a MOS 0. This is converted to a TTL 
and causes FF12 to become 1 one clock pulse later. 

At several points in this discussion, it has been 
necessary to assume initial states for several flip- 
flops. The timing of the circuit is such that, after a 
maximum cf 259 clock pulses from power on, the FF's 
must be in the state assumed. The number 259 is the 
total of 2 clock pulses to establish the state of FF's 
7 and 8, 128 more to finish readin, a maximum delay of 
127 (for scanning one clock pulse at a time) and 2 more 
clock pulses to clear FF12. 

It was mentioned earlier that the output start 
bit was loaded one clock pulse later than the input 
start bit. Nevertheless, it was possible to have read- 
out simultaneous with readin (t=0) under these circum- 
stances, due either to some peculiarity of the SAM or 
of the sequencing circuitry. It was also mentioned that 


scanning was possible only in two clock pulse delays. 


However, at power on , the circuit would either scan in 
delayitsequencel 0712 Aye .WRi 1 26vokEminesequenceniyes 5, 
sus. 1272 WOnceitthe) powers wast on, the Scanning: moderi(even 


or Odd) wast ixcdlar Attempts? tor obtains a. l2 8s pointeauto— 
correlation function by timing phasing variations were 
unsuccessful. All results reported here are for the even 


Scanning mode, so that a zero delay was obtained. 
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Results and Discussion 

Examples of several input and output waveforms for 
mie autocorrelator are shown in Plate 1.. The input 
waveform and delayed segment are shown in column I for 
Sine, triangular and square waves (ale KH2) te tHhenicor= 
responding output autocorrelation functions (scaler set 
to modulo-l) as they are displayed in real time on the 
oscilloscope are shown in column II. The time base for 
the autocorrelation function photographs was 10 msec/ 
div. Thus these autocorrelation functions are computed 
in about 52 msec. The break in each of the autocor- 
relation function photographs indicates automatic re- 
Start of the autocorrelator on application of another 
Seart pulse: 

It is clear from the photographs. that the serial 
analog memory is not distortion free. The delayed 
signal segments stored in the SAM show some significant 
amplitude distortions. In addition distortion can be 
observed in the autocorrelation functions, particularly 
that for the square wave which should be a triangular 
wave. As the signal delay was slowly scanned from zero 
to 126, three different types of distortion could be 
observed. mre have been labeled as fixed pattern 
noise, step distortion, and breathing. 

1.) Fixed pattern noise. -As the delay is Siecaky 


scanned, a noise pattern is superimposed upon the de- 
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layed signal and scans with it; i.e. the noise pattern 
is unaffected by the delay. The major probable cause 

of this type of distortion is diode-to-diode non- 
linearity. Such distortion has also been observed in 
Reticon photodiode arrays (37). The two spikes that 

are clearly visible about halfway along the delayed dis- 
nal in column Ib are an example of this type of dis- 
cortion. 

2. Step distortion. As the delay is slowly 
Seanned from zero to 126, a visible’ step occurs’ in the 
delayed waveform and moves along the delayed wave- 
form as a function of the delay. This step is most 
clearly visible in Column Ic. The first (leftmost) 
Square wave cycle is clearly lower than the two right- 
most*cycles. 

3. Breathing. As the delay is slowly varied, the 
amplitude of the delayed signal changes such that it 
is at a maximum when the delayed signal is exactly 180° 
out of phase with the undelayed generator output. There- 
fore, as the delay varies, the delayed waveform "breathes" 
up “and@-down in amplitude’) It is thas distortion that 1s 
probably the major cause of the asymmetry in the auto- 
correlation functions. 

The input-output amplitude characteristics of the 
SAM and the autocorrelator are shown in Figure 15. For 


an 8 kHz sine wave input with a p-p amplitude ranging 
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Figure 15. Log-log plots of output vs input for the serial 
analog memory (crosses) and autocorrelator 
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from 0.3V to 3.0V (one order of magnitude) the slope of 
@ log-log plot of SAM output vs SAM input is 0.97 + 0.02 
and for a log-log plot of autocorrelator output vs SAM 
anput the slope is 2.05 + 0.05. The SAM was just be- 
ginning to saturate with the 3V p-p input. | 

in Order -Costest the ability of \the autocorrela— 
tor in processing a noisy periodic signal, random noise 
was added to a sine wave signal. A 1.1V p-p sine wave 
with about 3V p-p added random noise is shown in column I 
of Plate 2a along with a delayed segment. The random 
noise was obtained from a General Radio Type 1390-B 
random-noise generator and had a bandwidth extending 
from 5 Hz to 20 kHz. It can clearly be seen in Plate 2a 
that the delayed noisy signal segment originates from 
the beginning of the upper trace although, as before, 
some distortion is evident. 

The sine wave is somewhat difficult to visually 
discern inte Originalssrqnal trace. However, che 
autocorrelation function computed in one cycle of the 
autocorrelator (52 msec) clearly reveals the periodicity 
of the’ noisy input: If the sine wave amplitude is) re- 
duced to 0.5V p-p the waveforms shown in Plate 2b result. 
By reducing the input amplitude by about a factor of two, 
the autocorrelation function amplitude drops by about 
APtacLtoOr of 42. Now lt as evensdirhacuit tosseevany 


periodicity in the autocorrelator output although the 
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| Plate 2. Autocorrelation Of noisy sine waves. 
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relatively large t=0 peak caused by the random noise is 
visible. 

As mentioned in the experimental section it is 
possible to time average the autocorrelation function by 
repeated evaluation and integration of the autocorrela- 
t2On function at One specific 1 value: \. This also allows 
plotting of the autocorrelation function on a strip chart 
recorder. The autocorrelation function obtained when 
the scaler is set at modulo-1000 and the time constant 
of the output low pass filter to 0.1 sec is shown in 
Figure léa. Now the period and amplitude of the auto- 
correlation function can easily be measured. Remember 
the input Signal is that shown in the upper trace of 
Plate 2b, column I. For comparison, the autocorrelator 
output in this mode for a noise free sine wave input 
is shown in Figure 16b. The total plotting time for 
each of these waveforms was 52 sec. 

It should be noted that the autocorrelation 
function provides a convenient means of determining the 
signal-to-noise ratio of the original waveform (3). 

The value of the autocorrelation function at T=0 is just 
the mean square of the original signal plus noise, while 
the peak Etude of the autocorrelation function at 
values removed from t=0 is equal to the mean square of 
the signal alone. For an alternating waveform the mean 


Square value is directly proportional to the power of 
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the alternating waveform. Thus the Signal-to-noise 
power ratio can be calculated from the mean square of 
the signal divided by the difference between the t=0 
value (S+N) and the mean square of the signal. On 
this basis the signal-to-noise power ratio in the 
original noisy sine wave calculated from its auto- 


eorretation. function (Figure.16a) 1s about_0.2. 


Conclusion 

This autocorrelator was not directly applied to 
a chemical signal. The primary aim of this study was 
to point out the availability and applicability of 
devices such as the serial analog memory to correlation 
measurements. Hieftje (7) has shown that correlation 
techniques can be advantageously applied to measure- 
ments where lock-in amplifiers are typically employed. 
Since lock-in amplification is widely used in analyti- 
cal instrumentation, the correlation approach has poten- 
tial wide applicability as instrumentation becomes more 
readily available to implement correlation analysis. 
Devices such as the SAM are sure to promote this develop- 
ment. In addition, the autocorrelation approach to 
processing a noisy periodic signal does not require a 
reference signal as is necessary for lock-in detection. 
It would be possible, for example, to measure the See 


tude of an input signal by adjusting the delay such that 
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observations were recorded at a local maximum (or minimum) 
well separated from the peak at T=0 (see Figure 16). 
This would provide data similar to that provided by a 
lock-in amplifier, but without a reference. 

Application of the SAM to chemical measurements 
is by no means limited to autocorrelation. Both transient 
recorders and cross-correlation instruments could be 
constructed using serial analog memories. The construction 
of a transient recorder using a device related to the 
SAM, a serial analog delay (SAD), has already been re- 
ported (38). Many additional applications are outlined 
in literature available from Reticon. Reticon has also 
announced the availability of a second-generation de- 
vice, the SAM-128LR, that allows retention of informa- 
tion tor, up|) toys seconds .at 25°C; vandsbhasua) dynamic 
range of 70 dB. This and further improvements in the 
construction of these devices can be expected to lead 


to both increased performance and lower cost. 
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CHAPTER, JV 


CROSS-CORRELATION I: A HARDWARE CORRELATOR 


Background 

Although lock-in amplification is a cross-correla- 
tion technique, only continuous signals may be handled by 
the simple lock-in amplifier of Chapter II. The auto- 
correlator of Chapter, III may be applied to repetitive 
Signals that are not necessarily continuous, but pro- 
vides an Output amplitude that is not linearly related 
to input amplitude. If a reference signal is readily 
available, a linear relationship of output with input 
may be provided by cross-correlation. In fact, depending 
upon the type of reference provided, cross-correlation 
allows selective extraction of information from a signal. 
If the reference is a noise-free version of the signal, 
the type of operation known as matched filtering is per- 
formed, ana results in Optimization Of the signal—to- 
noise ratio for peak height measurement (39-43). Matched 
filtering has been used by Miller (39) by cross-correla- 
ting noisy decaying exponentials with a noise-free 
reference. 

Cross-correlation may also be used to obtain a 
criterion of identification for signals consisting of 
a series of peaks, since a lange value OL the Crosse- 
correlation function at T=0 iS indicative of similarity 


between signal and reference (3). This procedure is a 
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Eype Of pattern recognition (45). With binary spectra, 
the application of Equation 2 results in an AND-sum (46,47). 

An example of the application of cross-correlation 
to emission spectra is shown in Figures 17 and 18 (from 
Reference 8). Figure 17 shows emission-spectra of Co; 
Nij;gand Fe in thelregion of (3430 to 3500 re The spectra 
were excited using an O,-H, flame and recorded photo- 
graphically. The plots of Figure 17 are the result 
Offdigitizing the output off a scanning densitometer (3). 

The Co spectrum was chosen as the sought-for 
spectral information. The Co, Ni, and Fe spectra were 
then cross-correlated with the Co spectrum to provide 
the patterns shown in Figure 18 (from Reference 8). 
Figure 18A shows the autocorrelation of the Co spectrum. 
There is a large maximum at T=0 as expected, indicating 
the similarity of the two spectra. The remaining pattern 
contains information about relative peak separations and 
is not easily interpretable. Also, since the pattern 
is an autocorrelation, it is symmetrical about T=0. 

The result of cross-correlating the Co with the 
Ni tand=Fexspectrasis“shown=in-Figures:.1e8B-and=18C.- Here, 
there is no distinct maximum at T=0 indicating that the 
two spectra in each case are dissimular. In addition, 
the cross-correlation patterns are quite complex and not 


Symmetrical. 


The large maximum at t=0 of Figure 18A and the 
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Figure 17. Cobalt, nickel and iron spectra. 
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small maximum of Figures 18B and 18C suggest that cross- 
correlation at tT=0 of a raw spectrum with a reference 
spectrum of the sought-for element may be used to deter- 
mine the concentration of the reference element in a 
complex matrix with a relatively low chance of inter- 
ference. In addition, there should be a significant 
increase in Signal-to-noise ratio due to the matched 
filtering operation (8). Beech has used cross-correla- 
tion for quantitative NMR analysis with digitized NMR 
spectra (48) and obtained a signal-to-noise ratio 
enhancement of about tenfold. 

Ponder for the cross=correlation “approach t0 
detection of spectral peaks to be useful, it is necessary 
to have some method of obtaining information at several 
different wavelengths simultaneously. An instrument that 
readily supplies such information is the diode array 
spectrometer P(37))s "In this ‘chapter;!'cross=correlation 
at t=0 of the output of a diode-array spectrometer with 
a reference spectrum stored in a specially designed 
transient recorder (49) will be used to quantitatively 
measure the atomic emission of elements in an inductively- 
coupled plasma (ICP) (50). This approach represents 
a unique "lock-and-key" procedure to the measurement of 
atomic emission, Since only those elements having spectral 
peaks at wavelengths identical to those of the reference 


spectrum can contribute to the correlation integral. 
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A block diagram of the hardware comvetaues is shown 
in Figure 19. The output of the diode array spectrometer 
is Connected both “to the input of the transient recorder 
and also to one input of the multiplier/integrator. The 
Output of the transient recorder is connected to the other 
input of the multiplier/integrator. A reference spectrum 
is stored in the transient recorder by measuring the 
emission of a concentrated solution of the element to be 
determined. The raw array output and the stored reference 
are then multiplied point by point and integrated over the 
wavelength range covered. The output voltage is thus 
proportional to the mutual areas of the signal and refer- 
ence, with contributions from all peaks of the reference 
in the wavelength region covered. 

Peels impomtant to note that this instrument gs 
based on a particular design for a transient recorder, 
that itself performs some of the sequencing required and 
also allows background subtraction (49). The construc- 
tion and operation of this transient recorder will now be 


discussed. 


The Transient Recorder 

Transient recorder has become the generic name 
for a simple digital data aquisition instrument con- 
sisting of an analog-to-digital converter, a digital 


memory, and a digital-to-analog converter (49) (see 
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Figure 20) although names such as time-domain conver- 
Sion system (51) and data logger (52) have also been 
used. Such an instrument is widely applicable to the 
acquisition and processing of laboratory signals and is 
frequently used to either obtain data at high speed and 
read it out later at slow speed, say on a laboratory 
recorder, or to obtain data at a low speed and read it 
Out at high speed to an oscilloscope or to a computer. 
Some basic designs have been presented in the litera- 
ture (10, 51, 52) and transient recorders are availa- 
ble commercially from such manufacturers as Biomation, 
Princeton Applied Research Corporation and Nicolet In- 
strument Corporation. In recent years components for the 
Main subsystems (ADC, digital memory, and DAC) have be- 
come available at very reasonable costs. With these 
components, a transient recorder can be built for at 
least a factor of ten less cost than most commerical 
systems. 

The transient recorder described here can be 
built for aycomeonent cost of about i$300.. «This design 
uses a 1024 word, (10 bit) digital shift register memory. 
Unique control circuitry allows subdivision of the 
memory into several units of variable and arbitrary 
length. Very often it is necessary to subtract a back- 
ground from a laboratory signal. Circuitry is provided 


for synchronized feedback of previously stored information 
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(i.e. a background scan) to an input difference ampli- 
fier which background subtracts an incoming signal. 

This circuitry is extendable to numerous other data 
processing operations such as division (ratio), log 
ratio, multiplication, and addition. Finally, the design 
includes the sequencing for a versatile pretrigger system. 
Pretrigger refers toi the ability of"a transient recorder 
to acquire data "before" the arrival of an instrumental 
trigger pulse. In actuality the transient recorder 

is allowed to free run (continuously acquire data) and 
the trigger pulse then functions as a stop pulse. The 
design presented here allows precise variation of the 
pretrigger delay (number of points obtained before the 
arrival Jota targger. pulse) Jiromyzero to LO23ham units 

of one. 

Although the final design differs considerably 
from that of Korte and Denton (51) and has several addi- 
tional features, their circuit was a great aid in the 
initial design stages. 

A schematic diagram of the transient recorder is 
shown in Figure 21. The analog-to-digital converter 
(Model ADC-10Z) and digital-to-analog converter (model 
DAC-102-3) were both obtained from Analog Devices. The 
ADC-10Z is a 10-bit successive approximation ADC with a 
conversion time of 20 usec. The DAC-10Z-3 is also 10 


bits®with a settling time of 5 usec. A wide variety of 
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conversion modules could be used other than these de- 
pending on the desired specifications of the transient 
recorder: 

The? 10-bit) by 1024 word digital shift; register 
memory was built up from ten Signetics 2533 1024-bit 
static shift registers. These registers are TTL com- 
patible and can be clocked from dc to 1.5 MHz. Again a 
wide range of shift register integrated circuits could 
be utilized for the memory section of the transient re- 
cordéeér., Fortvexamplethex? S2=bitendualid28=bat; @oquadrs0-— 
bit and dual 256-bit are some of the configurations 
available for static shift registers. Static registers 
are recommended over dynamic registers unless high 
speed (10 MHz) is required. The rest of the circuit 
is the timing and sequencing block and the key sub- 
system is the modulo-1024 presettable counter. It con- 
sists of three 74193 presettable 4-bit binary up-down 
counters. 

The transient recorder was breadboarded using 
a Heath EU-801 Analog-Digital Designer. The ADC and DAC 
were each mounted on cards which plugged directly into 
the Heath unit. The 10-bit by 1024 word shift memory 
Wasiaiso built on alsinglercardnthat® plugged antorthe 
Heath unit. The standard Heath cards and modules were 
usedeforathesrest offthe cireuztry. 


The operation of the circuit will first be dis- 
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cussed in its NORMAL mode for the simple acquisition of 
1024 data points after application of a trigger pulse. 
Assume that FFl is in the 0 state (Q=0) and that FF2 is 
ARMED (reset, Q=0). This puts the circuit in a READY 
condition. In this condition the preset count (assume 0) 
is automatically loaded (output of G7=0) and the arrival 
of a trigger pulse is awaited. Upon application of a 
trigger pulse either manually or externally from an 
experiment FF2 is toggled to the 1 state (Q=1) opening 
gate Gl. Note that any subsequent trigger pulses are 
ignored (K=0 of FF2) until the circuit is rearmed. 

When gate Gl is opened, the input clock fires 
mono-l (set for about 200 nsec) thereby initiating analog- 
to-digital conversion. The STATUS output of the ADC con- 
trols the track-and-hold amplifier and fires mono-2 (set 
for about 400 nsec) at the end of a conversion, which 
writes a new word into the memory. Pulses from Q of 
mono—2“are’ applied to “the count-up Input ‘or*the *presetta-— 
ble modulo-1024 counter. The overflow pulse occurring at 
the 01024 cutptit toggles FF1 ‘to the PT state “(Q=1)"," thus 
Closing gate ‘Gl andi"s'toppitig ‘data acquisition’ ‘Note 
that upon completion of data acquisition FFl is locked 
Paiva CS2hI at ee by the connection to K from Q of FF2 and 
that FF2 is inhibited from undergoing a 0-1 transition by 
the connection to J from Q of FFl. The reasons for these 


interconnections will be presented later. 
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Two Output modes are provided in theseircue, 
CIRCULATE and TRANSFER. The CIRCULATE mode is for 
repetitive output (oscilloscope) and the TRANSFER mode 
(push button or external control) is for non-repetitive 
Output (recorder). When data acquisition is terminated 
the circuit may be in either mode. For normal operation 
when acquiring data we set the output mode to CIRCULATE 
and the output clock to a high frequency (50-100 kHz). 
With this arrangement the acquired waveform is auto- 
matically displayed on the oscilloscope immediately 
after data acquisition is terminated (i.e. when FF1 is 
toggled to.the 1 state). .In,the. CIRCULATE mode. (0),. the 
output of G4 must be a l and this, with the 1 at the Q 
of FFl1, opens gate G2 and puts the memory (stream select 
1) in the recirculate mode. Note that in this mode FF3 
eculockedainethe. OL states by. the: J Jjconnection.s 4The 
Output.of,the,tenth bit, of.the.countex, (01024),.1s5,used 
to trigger the oscilloscope for trace synchronization. 

If, during the CIRCULATE mode, the TRANSFER mode 
(Tt) 3s selected; the, next, 170, transition, from, 01024 
will toggle FF3 causing the output of G4 to be a 0 and 
closingsG2 ,~f{hus,ceasing data cirenlation. wAL. this. time 
the, memory output will contain, the first.word of,storage. 
If the TRANSFER INITIATE switch is then momentarily 
depressed or if a momentary 0 is applied to the EXTERNAL 


TRANSFER line, FF3 will be reset and the data will 
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Circulate once, again stopping with word number one at 
the memory output. This mode is used for recorder out- 
put (with a slow output clock) or for synchronizing 
readout of the transient recorder with an experiment. 

Now, let's assume that the transient recorder is 
in its CIRCULATE mode (oscilloscope) and that we want to 
take in some new data. The circuit can be put into the 
READY condition by applying an ARM pulse. This resets 
PR2, unlocking FFI from uts I} state so that the next 70 
transition at Q1024 toggles it to the 0 state, closing 
gate G2 and ceaSing data circulation. Note that until 
FF1 toggles to the 0 state FF2 cannot accept a trigger 
Pulse because Of the connection ‘to/ J. from 0 of FFI @fhus 
an ARM pulse puts’ the cicuilt in a READY Condition with 
the memory output, and hence DAC output, containing the 
first word of the previously acquired data. This impor- 
tant feature allows modification of new data input to 
the transient recorder by previously acquired data. For 
example, the difference between a new signal and a pre- 
viously acquired signal can be obtained simply by in- 
cluding a difference amplifier in a feedback loop between 
the output ands the input (see Figure 22)... This arrange=- 
ment allows background subtraction of signals acquired 
from ar photodiode array spectrometer. 

It is possible, in the NORMAL mode, to acquire 
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then only 512 points are acquired. Upon termination of 
data acquisition (in the CIRCULATE mode) the circuit still 
displays 1024 points as the LOAD function is only acti- 
vated in the READY condition. If, after acquiring and 
eisplaying 512, points, the, circuit is put in the READY 
condition by arming it, a second 512 point waveform can 

be acquired so that two independent 512 point signals 

can occupy the memory. This amounts to dividing the 
Memory into two segments. If the counter is set to 768 
(1024-256) then 256 points would be acquired and four such 
waveforms could be stored in the memory. Thus, by appro- 
priate manipulation of the presettable counter the memory 
can be subdivided into several units of variable and 
arbitrary length. This very flexible memory subdivision 
adds considerably to the capability of the transient 
recorder. 

As mentioned earlier the circuit can also be 
operated in a PRETRIGGER mode. In the PRETRIGGER mode the 
output ‘ot, gate.Gawisea, lusouthae data acquisition. starts 
as soon as the circuit is in the READY condition. In 
this.conai tion.thesoutput.of gate.G7 is .a.0 which ovyer-— 
rides the counting function of the presettable counter. 
The Re eee in this free running mode, continuously 
Acduiring data,.until sa trigger pulse is received, ,Appli- 
Cation.of.astrigger.pulse frees the .counter,and allows 4t 


to count up from its preset condition to L024... Thesolo24 
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Output terminates data acquisition in the normal way. 
Thus, if the counter is preset to 0 the shift register 
memory will contain 1024 samples of the input signal 
occurring after the trigger (start) pulse; if preset 
EO 512, 20 wiil contain 512) samples acquired before 
the trigger pulse and 512 samples acquired after the 
trigger pulse. With this design the pretrigger delay 
Can eGCasily be varied from zero to 1023 in units of one 
using the preset inputs. 

The Operation of the transient recorder is shown 


in Plate 3 and Figures 23 and 24. Memory subdivision 


toil lustrated in Plate 3. -A £ulid 1024) point acquisition 


a>) Shown in) Plate) Ga, four 256° point,acquisi tions: in 
Pirate-3b and three acquisitions of 192; "320 and 512 
points are shown in Plate 3c. Memory subdivision and 
background subtraction are both illustrated in Figure 
23. The memory was subdivided into four 256 point seg- 
ments. The first segment contains an optical spatial 
pattern as measured with a 256 element photodiode array 
(37). ‘This-array has a strong sinusoidal. fixed pattern 
background noise. This can be subtracted out uSing the 
system shown in Figure 22 and the result is stored im 
the second segment of memory (Figure 23b). The array 
background is stored in segment 3 (Figure 23c) and the 
signal stored in segment 4 (Figure 23d) is the result of 


subtracting two repetitions of the signal in 234.9) [ne 
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Placer 3c 


Oscilloscope photographs illustrating normal 
and memory subdivision modes of the transient 
recorder. (a) Full; 1024 point acquisition: 
(b) Four successive 256 point acquisitions of 
independent signals. (c) “92: $20" and =S2 
pointwacquisi trons. 
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Plate 3 
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small residual in the central part of Figure 23d indicates 
that intensity drifted between the two measurements of 
the optical Spatial pattern. . The Leped shown in Figure 
24a 45 a Spectrum of neon in the region of 610 nm as 
measured from a photodiode array spectrometer. It was 
measured in the NORMAL mode and a total of 1024 points 
being obtained at a rate of 45 Hz and then output to 
Pectadrterecorder at  / points/sec. This Spectrum is 
identical to that obtained from a minicomputer data 
acquisition system for a Single scan without background 
subtraction. The noisy base line is due to fixed pattern 
moise- and dark current (see reference 37). The PRE- 
TRIGGER mode is illustrated in Figures 24b and 24c. In 
these cases 256 and 512 points were acquired before the 
trigger pulse that initiates the scan of the photo- 
G@iode array. It should be noted that the transient 
recorder cannot be simultaneously operated in both the 
background subtraction and PRETRIGGER modes. 

A transient recorder can add considerable flexi- 
Dijaty [© ai variety of data acquisitvon tasks in the 
laboratory. Typical applications range from the measure- 
ment of transient atomic absorption signals generated 
by furnace and carbon rod atomization systems to stopped- 
flow measurements. For many minicomputer systems it can 
provide a simple off-line oscilloscope refresh system 


or it can be used to transfer plots to a recorder, freeing 
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the minicomputer for more important data acquisition or 
processing tasks. In addition, the transient recorder 

is a fundamental building block for more sophisticated 
instrumentation. Systems with dual memories or even two 
transient recorders combined with analog components such 
as multipliers, dividers, difference amplifiers, log 
modules, and log-ratio modules can perform a large variety 
of data processing tasks, as can the single memory system 
presented here with synchronized feedback. In fact, the 
modification of this transient recorder to perform hard- 
ware cross-correlations is exceedingly simple. Finally, 
it is interesting to note that the recent development of 
analog shift registers in integrated circuit form is sure 
to have an impact on transient recorder instrumentation 
(34). These devices offer the potential of replacing the 
major functional blocks of the transient recorder (ADC, 
digital memory, and DAC) with a single 16 pin integrated 
Gircuit dandtinetace the construction (of ia Nigh speed 
transient recorder uSing a serial analog delay line 


integrated circuit has already been reported (38). 


Experimental 


Inductively coupled plasma. A commercially availa- 
ble ICP (Plasma-Therm Inc., Rte. 73, Kresson, N.J. 08053) 


was used aS a source of emission spectra. The torch 


output was imaged with a circular lens onto the entrance 
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Slit of the photodiode array spectrometer. The diode 
array used contained 1024 elements and provided about 50 
nm Of wavelength coverage. 

Operating conditions for the ICP and spectrometer 
are given in Table II, and are not necessarily optimum. 
Chemicals. Stock solutions (1000 ppm) were made of 
reagent-grade metal salts. Standard solutions were pre- 
pared aS required by dilution and used immediately. 
Instrumentation. The transient recorder/hardware cor- 
relator was breadboarded using a Heath EU-801 Analog- 
Digital Designer. Standard Heath cards were used for the 
correlator module except for the sample-and-hold ampli- 
fier (model SHA4), which was obtained from Analog Devices. 

A schematic of the correlator is shown in Figure 
eo Circuit operation i'si based Jon ithe (1024—point /tran- 
Sient recorder (TR) with background subtraction capabil- 
ity already described. The TR was used in the NORMAL 
mode without memory subdivision, i.e. all 1024 points 
from the diode array were stored for the reference. dhe 
array clock is used to control both data acquisition and 
data recirculation so that these two processes will be 
precisely synchronized. In order to load the reference, 
the most concentrated of the standards to be run was 
aspirated into the plasma and the TR was ARMed. When a 
spectrum had been acquired, a water blank was aspirated 


and background subtraction was performed. Multiplication 
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TABLE II 


Operating Conditions of ICP and Spectrometer 


RF frequency 

RF power 

Coolant flow 
Nebulizer pressure 


Observation height 
(above top of coil) 


Array center (nominal) 


Slit width 


Z27etes MHz 
19 —2 0 KW 


14-15 lpm 


B2epsit ‘Ca: 30npsin Cr 


227mm Was 25 mm iCcr 


407.5 nm>Ca+ 


100 um 


420-0" nm-Cr 
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and integration were performed with a simplified version 
Or =the Cireuitry used? in*Chapter Mi1% 

In order for the correlation to proceed correctly, 
the TR must be operated in the TRANSFER mode. The ref- 
erence spectrum will then be stored with the first point 
available at the TR output. A sample or standard is then 
aspirated into the plasma and its emission detected. A 
START pulse from the array toggles mono-l, beginning re- 
Circulation of the reference spectrum. The TR output 
is amplified and inverted by OAl and clipped by diode Dl 
and resistor R3 to provide noise immunity. The multiplier 
output is thus the product of the raw sample spectrum 
and the clipped, background-subtracted reference spectrum. 
Simultaneously with the start of spectral multiplica- 
—70n, FRI is ‘toggled, opening Ol-and alilowing™integra— 
t1On Orsthemmultiplier output by R4 and Cl.) When ret— 
erence recirculation is complete, the SYNC pulse from 
the TR toggles mono-2, causing the sample and hold ampli- 
fier to acquire the integrator output.” ~ The=ftallang edge 
of mono-2 toggles mono-3, which resets FF1, closing Ql 
and resetting the integrator. The falling edge of mono-3 
may also be used to trigger a readout device such as a 
digital voltmeter. Gates Gl, G2, and G3 ensure that the 
TR cannot recirculate until all sequencing has been 


terminated. 


Potentiometer Pl may be used either to ensure that 
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integrator output is constant between peaks or to adjust 


the sampled voltage to be zero when a blank is aspirated. 


Readout System. Output voltages were measured with a digi- 
tal voltmeter (DANA Model 5400) and sent by a SERDEX in- 
Perr ace (55), tO a teletype for printing. Detadls oruene 
SERDEX interface are given in Appendix I. Additional 
circuitry allowed printout of ten successive values on 


command. 


An alternative approach would be to low-pass 
filter the SHA output to be measured on a chart recorder, 
as was done with the SAM (35). 

The linearity of the correlator was determined 
with a sine wave generator with R2 = 100 kr, R4 = 100 kr, 
and Die andth3 notin circuit. The resulting ‘datayare 
shown in Figure 26. 

For*a-10-V p-p’reference™at745 Hzywith a” clock 
Pate10Of)45 KHZ, a plot Giveutpul versus input \forain- 
DUtSeZOLVO NS ito 5) volits: pop" yrel dedgargcorrelatronmcos 
efficient of 0.999919 on a linear plot anda slope or 
0.9994 + 0.0041 on a log-log plot. Operated in this 
manner the correlator acts essentially as a lock-in 
amplifier. a) however, a large number of cycles of the 
reference waveform are stored in the TR, then the Q 
of the circuit will be so high that output instability 


will result unless either both the input frequency and the 
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clock frequency are extremely stable or they are synchron- 
ized by some means. In the correlation of diode array 
spectra, clock pulses are synchronized with diode position, 
so the correlator output is stable with respect to clock 
Gratt. lf the correlator was. to ibe used as a lock-in 
amplifier, stabilization could be ensured by multiplying 
the sine-wave frequency by a phase-locked loop (10) to 


obtain the clock signal. 


Results and Discussion. 

Operation of the correlator is illustrated in 
Pilate v4 for calcium. The raw (unfiltered)? array output 
for 10 ppm Ca is shown in Plate 4a. This is stored in 
the TR and background subtracted as described to yield 
the reference spectrum, Plate 4b. Multiplier output is 
shown in Plate 4c, and the integral in Plate 4d. Clearly, 
contribution to the integral is made only by the three 
Gariines (42227, 396-8. 393.4 nm)tmandethe output voltage 
contains a contribution from all the peaks. Since the 
Taw array output is not background subtracted, there 
will be a blank caused by array dark current and the 
argon continuum, plus any overlapping lines. The value 
of the blank will depend on array integration time and 
efficiency of cooling, height of observation in the 
plasma, wavelengths observed, plasma operating conditions, 


and element under investigation, and can be quite sig- 
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Plate 4. 


Oscilloscope photographs illustrating correlator 
Operation for calcium determination. (a) Raw 
diode array spectrum of 10 ppm calcium showing 
lines at 422.7, 396.8 and 393.4 nm. (bjeee 
ground subtracted reference. (c) Multiplier out 
put. (d) Integrator outpuc. 
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nificant (0.1+1 volt) with potentiometer Pl adjusted so 
that integrator output is constant between peaks, as in 
Plate 4d. 

The use of the correlator to determine calibration 
curves for standard solutions of calcium is illustrated 
tiebagure 2/.. Figure.27a is a plot“of net correlator 
output in volts versus ppm Ca for solutions from 1-10 
ppm. Each point is the mean of 10 measurements. The 
emission lines used were at 422.7, 396.8, and 393.4 nm 
with an array integration time of 4.32 sec. A least 
Squares treatment of the data yielded a regression line 
With»a, slope of 0.1810.) 0.0057 V/ppm, an intercept, of 
=0.021 + 0.033 V, and a correlation coefficient of 
0.998000. The relative standard deviation of the 10 
measurements of the 10 ppm solution was 3.2% and the 
detection limit based on a S/N of 2 was 0.4 ppm. The 
same solutions were run by T. Edmonds under the same 
operating conditions but utilizing a computer based 
data acquisition system (37) and a software integration 
to yieldythe data Of FigureyZz/D. sere, .cachspornts 
the total of ten successive background-subtracted array 
scans. A least squares treatment yielded a slope of 
16905700 26: unsts/ppm,.. an anterceper Olu 0.235 
WnitS, vand) a correlation coecrficientpor 0.999889.) sinis 
software calculation is clearly of higher accuracy than 


the analog treatment. 
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1.58 


OUTPUT VOLTS 
8 1.03 


8.63 


8 10.00 


0.00 82.50 = tae dni 
PPM CALCIUM 


159.28 


TOTAL AREA (X10! _) 
198.88 


59.69 


8.93 


18,80 


- | A 2 } 5.08 7.59 
i 250 PPM CALCIUM 


(a) Correlator output vs calcium concentration. 
(b) Software peak area (arbitrary units) vs 
calcium concentration. The same solutions were 


used in both cases. 
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Calibration curves for chromium are illustrated 
in Figures 28 and 29. The analysis lines used were at 
429.0, 427.5, and 425.4 nm. For a concentration range 
Of 0=100>ppm (Figure 28) an integration time of 2.2/6 ‘sec 


was uSed. A least squares treatment yielded a slope of 


Om02994 + 0200029; V/ppm, an intercept of -0.062 + 0-017 Vv, 


and a correlation coefficient of 0).999817. "The relative 
standard deviation of the 100 ppm solution was 2.2%, and 
the detection limit for a S/N of 2 was 4 ppm. The 
detection limit can be lowered by utilizing a longer 
integration time. This effect is shown in Figure 29, 
in which solutions of 1-10 ppm Cr were measured with an 
integration time of 14.40 sec. A least squares treatment 
yielded a regression line with a slope of 0.06317 + 
On00078° V/7ppm,. “an “intercept of —0.008 52707005: V,andaa 
correlation coefficient of 0.999693. The relative stand- 
ard deviation on ten readings of the 10 ppm solution was 
iS8e) and«the detection limit based on a S/N of 2 wasii0.5 
ppm. The large decrease in observed output voltage in 
Figure 29 compared with Figure 28 is due to a decreased 
net signal intensity from reduction of array dynamic 
range by increased dark-current pedestal (37). 

Actual array output spectra (without background 
subtraction) are shown in Figure 30 for 10 and 1 ppm Cr 
with the same operating conditions as used in Figure 29. 


The large pedestal is clearly visible, as well as the 
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Correlator outputivs ‘chromium concentration. 


Prgures 297. 
= Integration time 2.16 sec. 
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fixed-pattern noise on the unfiltered array output (37). 
Discernment of the chromium triplet on the 1 ppm solution 
is difficult or impossible with the unaided eye. 

The background noise level of the multiplier/ 
integrator was determined by grounding the x and Y inputs 
of the multiplier and sequencing the correlator with the 
diode array and transient recorder in the normal way. 
Measurements of the output voltage then gave a standard 
deviation of 8 mV on ten readings. Standard deviations 
on the data shown in Figures 27a, 28, and 29 ranged from 
Goan e(tor: 100 ppm Cr) ‘tovli mV (for 10) ppm Cr at san 
integration time of 14.40 sec). These data indicate 
that the major sources of noise do not originate in the 
correlator itself, but rather in the diode array and/or 
in the plasma. 

Because this approach maximizes sensitivity by 
determining the total area of all elemental lines in 
the wavelength region covered, any lines that overlap 
With any Of the lines of the analyte will cause an inter; 
ference in the determination. A method of eliminating 
this type of interference is shown im Plate 5. The 
upper trace (Plate 5a) shows the chromium triplet 
Tocated at 1360 -5,) 25900; and So7-98nm. (lhe- right-hand 
line ‘of the triplet overlaps ‘partially with the weak 
iron Vine at 358.1 nm. The iron, interference can be 


reduced or eliminated by a stripping procedure illustrated 
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Plate 5. Oscilloscope photographs illustrating the use 
of a stripped reference. (a) Raw diode array 
spectrum of 10 ppm chromium showing the lines 
at 300.5, 359 4¥ances oa. on (b) Chromium 
reference after subtraction of spectrum from 
1000 ppm iron. (c) Reference spectrum at 
multiplier input, after inversion and clipping. 
(d) Raw diode array spectrum of a mixture of 
10 ppm chromium and 100 ppm tron. (e) Integra] 
tor output for multipl@er inputs of Me)mane 
(a)e 
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(d) 


Plate 5 


: oa m a i 


in photographs b, c, d, and e. The raw chromium 
spectrum is loaded in the transient recorder in the 
normal way, but instead of aspirating a water blank 

for background subtraction a concentrated iron solution 
(1000 ppm) is employed. When the background subtrac- 
b10Onp iS performed, the trace of Plate 5b results. The 
higher concentration of iron causes most of the lines 

to saturate the array and the overlapped (left-hand) 
portion of the 357.9 nm (right-hand) line is stripped 
from the reference. Other unoverlapped iron lines become 
negative, Since both the A/D and D/A convertors in the TR 
are bipolar. This spectrum is then amplified and in- 
verted by OAl and clipped by Dl and R3, yielding the 
erace=ot Plate 5c at the Y-input of the multiplier... othe 
negative iron peaks have now been removed from the 
reference. Correlation of this stripped reference with 
the spectrum of a solution containing 10 ppm Cr and 

100 ppm Fe, in which the intensity of the overlapped 
limelis clearly out.ofuproportion ~wields. thesintegras 
tor Output shown in Figurvespesegriie Largest contribution 
to the integral is now made by the unoverlapped 359.3 

nm chromium line. A plot of correlator output, versus 
iron concentration is shown in Figure 31 for solutions 
containing 10 ppm Cr and 0, 30, 100, and 250 ppm Fe. 
Correlation with a normal (unstripped) Cr reference (tri- 


angles) yielded a slope of 0.00106 + 0.00017 V/ppm Fe, an 
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Figure 3l..)+Correlator;output vs ppm iron when uSingean~-un- 
stripped (triangles) and stripped (squares) 
chromium reference. See text for discussion. 
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intercept of 1.486 + 0.023 V, and a correlation coeffi- 
erent 70£507976: 

A similar treatment of the same solutions but using 
a stripped reference is also shown in Figure 31 (squares). 
A least-squares treatment yielded a slopesosa0;000Ziy & 
0.000341 V/ppm Fe, an intercept of 0.697 + 0.046 V, anda 
correlation coefficient of 0.410. The iron dependence 
was therefore reduced markedly by the stripping procedure, 


although at the cost of halving the output signal. 


Conclusions 

Hardware correlation provides a fast and highly 
automated way of reading out the diode array spectrometer. 
The calculations are performed as guickly as the data 
Canwbe-readtout, ise: 23 mseciforsl024spointssata45rkHz. 
In general, this time period will be so much enowee than 
the time between scans (integration time) that the data 
can be regarded as being available instantaneously. 
Although the instrument as described uses an analog 
correlation, accuracy could be increased by converting 
the raw signal to digital form and using the transient 
recorder output to gate a high-speed binary adder, there- 
by performing a digital correlation. With such an 
approach, the transient recorder need only store a Logi- 
cal one at each peak position to gate the binary adder. 


Therefore, the amplitude resolution required of the 
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transient recorder need not be as high, and a one-bit 
analog-to-digital converter, i.e. a comparator, could 
provide sufficient resolution. This approach would 

also reduce the number of shift registers needed in the 
TR memory. Background subtraction could also be per- 
formed digitally. While the instrument does not perform 
T variation, this could be accomplished either by the 
circuitry of Chapter III or, perhaps more simply by 
scanning the monochromator (44). 

The correlator has been so designed that a 
reference can be loaded and results obtained simply by 
pushing a button; very little operator expertise is 
required for use of the correlator itself. Although 
a computer data acquisition and treatment routine could 
be written that would allow Similar ease of operator 
training, the speed of a software computation would be 
much less and the cost, at least at present, much 
greater. The self-aligning nature of the correlation 
procedure makes monochromator adjustment noncritical, 
yielding a technique for atomic emission that is as 
specific as is the use of a particular hollow-cathode 
lamp for atomic absorption. In addition, correlation 
provides the opportunity of performing sequential multi- 
element analysis simply by changing the reference spec- 
trum. The use of hardware correlation for the readout 


of emission spectra therefore provides a remarkable 
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degree of flexibility in both design and operation, accord- 


ing to the specific requirements of each individual user. 


CHAPTER V 


DIGITAL FILTERING 


Background 

The correlation operations discussed so far involve 
the direct implementation of the correlation integral). 
An alternative method that has become popular in recent 
years WS the Fourrer transform implementation of correla-— 
eiOn, 1.6. multiplication of the Fourier=transforms of 
the signal and correlation function and inverse Fourier 
transformation of the result (54-61). This procedure 
ms dllustrated pictorially in Figure 32 (from Reference 
3). The original noisy spectrum (Figure 32a) is trans- 
formed to yield the Fourier domain representation 
(Figure 32d). High frequency noise in the Fourier spec- 
trum is eliminated by boxcar truncation (Figure 32e) to 
give a modified Fourier domain representation (Figure 
820). inverse transformation of Figure 82f yields the 
smoothed spectrum (Figure 32c). The same result could 
be obtained by cross-correlating the original spectrum 
(Figure 32a) with the time domain representation of the 
Fourier domain smoothing function, i.e. a sinc func- 
Pironmrroure ccbD).. Figure’ 31 easy Cicretore -apic oral 
representation of Equations 4 and 5. 

Peechapters Lip lhl, andelva we haves dice 
cussed the direct application of the correlation in- 


tegral (equation 4). In, this chapter, we will discuss 
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the Fourier transform route of B@uati ones 3" The tmese 
part of this chapter will deal with the application of a 
Simple Fourier domain digital filter that readily allows 
various types of signal modification (54). In the second 
part, the Fourier domain representation:-of a popular 
class of digital filters developed by Savitzky and Golay 
(62) will be presented. The calculations to be dis- 
cussed were carried out on a PDP8/e computer using a pro- 


gram (DIGFIL) given in Appendix II. 


A. The Fourier Transform Route 

In this study, the application of a very simple 
but versatile Fourier domain digital filter is illus- 
trated (54). The filter is based on a Simple trapezoid 
that has been widely used as an apodizing function in 
Fourier transform spectroscopy (63, 64). When applied 
to spectral signals this filter is remarkably versatile. 
Through the manipulation of four numerical indices 
smoothing, differentiation, resolution enhancement or 


deconvolution can easily be implemented on a Signal. 


Experimental 


The spectra used to demonstrate the application 
of the digital filter were measured using a computer- 
coupled photodiode array spectrometer (37). *=Sources 


used included a dc arc and a Mg hollow cathode lamp. 
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All calculations were carried out in, the |PDP-8/e 
computer which is part of the data acquisition system 
for the photodiode array spectrometer. Programs were 
written in FORTRAN and run under the OS/8 operating 
system. 

The digital filters were implemented using the 
Fourier transform route as illustrated by Equations 4 
and 5. A Fast Fourier Transform (FFT) (65, 66) was 
used to carry Out the transformation of the spectra 
and the inverse transformation of the filtered Fourier 
domain signal. The output of the FFT subroutine con- 
Sists of two series, X(J) and Y(J), which are the real 
and imaginary components of the transform. All 
filtering operations were carried out on the real part 
OLithe transform 1(XG)) je. Thus »%(J), corresponds sto 7A (£) 
in Equation 5 and will be referred to as the Fourier 
domain signal. 

Lf .the spectrum. (a.(x) )) consisted: of. Nydigital 
spectral points, then N values of both the X(J) and Y(J) 
arrays were calculated using zero filling (67). After 
Ebltening (Eq... (5) jy. the Nuvaluess ofthe .hi i teed 
Fourier domain signal (C(f)) were transformed back, 
again using zero filling, to N values of the real (X(J)) 
and imaginary (Y(J)) components of the transform. On 


this second transform, the N values of the real array 


are the desired filtered spectral components (c(x)) (56). 
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Zero filling provides interpolation (68) as well as 
keeping all arrays at the same length, a major 
convenience in Fourier domain Siditar filtering opera- 
ELons’. 

the Fourier domain digital@m@ilter (8(£) im Boteation 
5) waS a Simple trapezoid characterized by four indices 
(NiGeeN2, No, N4)> that'derine ine vertices of the trape- 
Ze stypical Fourier domain digital filters that can 
be obtained by manipulation of the integer values of the 
four indices are shown in Figure 33. The vertical 
aotted Zine indicates the position.of the first point 
MOFEZIOOL the Fourier domain Signal. Digital £1 ltering 
is implemented simply by multiplying the Fourier domain 
Sionaleby sEhe appropriate falter function.» Signal 
points between Nl and N2, and N3 and N4 are multiplied 
bye the: “y" value of the slope, which varies linearly be- 
tween 0 and 1. Signal points between N2 and N3 are 
not altered, and those less than Nl and greater than N4 
are set equal to zero. To implement ..a particular filter 
the operator simply types in the desired four indices, 
Niv eN2nNS) and N4d“at- the: computer terminal. ~ff Noa 
zero ana N2ias equal to 1, a fittes such as that show 
in Figure 33a results; whereas setting Nl negative and 
NZ) positive’ (ol) results in the Ei iter shown: ans igure 
33e. The remaining figures indicate other possible 


filters obtained by varying the values of the indices. 
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Additional Fourier domain digital filters can be 
obtained by successive application of the filters shown 
in Figure 33. Successive application of the filters 
shown in Figures 33b and 33c results in the filter shown 
in Figure 34a. Similarly, the filter shown in Figure 
34b results from two successive applications of the 
filter shown in Figure 33e, once with N2=N3 and the 
second time with N3=N4. 

Several signal processing operations can be 
carried out on spectra using these digital filters. The 
filter shown in Figure 33a is used for general purpose 
smoothing and high frequency noise elimination. Diagno- 
Sis of noise information is often useful and can be 
carried out using the filter shown in Figure 33f. 
Differentiation can be accomplished using the filters 
shown in Figures 33b, 33c, 33d and 34a and deconvolution 
can be approximated uSing the filters shown in Figures 
33e and 34b. These operations are all discussed and 


Pidustratea in: the nextuseceion. 


Results and Discussion 

The distribution of signal and noise information 
in the Fourier domain representation of a noisy signal 
is such that signal information tends to be concentrated 
in the first part of the transformed noisy signal and 


noise information, particularly if it has high frequency 
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components that are separated from the signal information, 
tends to appear in the later part of the transformed 
noisy signal (55). In such cases, digital filtering 
can be quite effective in minimizing the noise on a 
Signal. A spectrum is shown in Figure 35a (Mg triplet 
at 382.2 nm) that contains high frequency noise, 
particularly on the peaks. This noise was caused by a 
faulty power supply in the measurement system. The 
real part of the Fourier transform of this noisy sig- 
anl (Figure 35b) clearly reveals the presence of excess 
high frequency noise. The Fourier domain signal shown 
im Figure 35b7%s6..256 ‘points long. Application of 
the filter shown in Figure 33a with N1l=0, N2=1, N3=99 
and N4=100 results in the retransformed spectrum shown 
in Figure 35c. Note that the majority of the high 
frequency noise has been removed from the spectrum. 

From a diagnostic point of view it may be useful 
to determine the distribution of the noise in the sig- 
nal domain. This can be accomplished by uSing a filter 
Withoandices equal to W9, 1007 2557 256m (see) Biguress ot ):. 
The result of applying such a filter is shown Jin Figure 
35d, which indicates that the noise was concentrated in 
the region of the spectral peaks. 

Further examples of the effectiveness of Fourier 
domain digital filtering in removing high frequency 


noise components are shown in Figure 36. The spectrum 
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shown in Figure 36a contains an intense fixed frequency 
noise component. Its transform (Figure 36b) indicates 
that the noise is concentrated at about the 125th word. 
A filter with indices equal to 0, 1, 99, 100 easily 
removes this narrow-band high-frequency noise Soneonere 
(see Figure 36c). Also, if desired, a software notch 
Preterm could ‘be set “up ‘for noisev’or this type. 

With low level signals quantizing noise can be- 
come serious as shown in Figure 36d. Quantizing noise 
has considerable high frequency components as shown by 
the transform of this signal (Figure 36e). Application 
Gira adrqvtal tilter with indices’ equalksto"0 eh, #27; LOO 
and retransformation yields the spectrum shown in Figure 
36f, in which the effects of quantization noise are 
considerably reduced. 

The derivative theorem of Fourier transforms (69) 
states that if the imaginary part of the Fourier trans- 
form ‘of a function “is "multiplied by! a inear’ramp start— 
img atthe orrvgin, the result tsWtne "real "parts fete 
Fourier transform of the first derivative of the original 
function. In practice a linearly decreasing ramp is 
often combined with the increasing ramp to avoid undue 
accentuation of high frequency noise (55, 70).  Such-a 
digital filter can easily be set up uSing the trapezoid 
indices as shown in Figure 33b. The first derivative is 


perhaps of minimal use in processing peak type signals 
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although it has found application in detecting peak locations 
by use of the zero crossing value. However, if the filter 
shown in Figure 33b is applied instead to the real part 

of the Fourier transform of the signal and the resulting 
function (which now is the imaginary part of the Fourier 
transform of the first derivative of the signal) is 
retransformed, a resolution-enhanced signal is obtained. 
This is illustrated in Figure 37, in which the real part 
of the Fourier transform (Figure 37b) of the spectral 
Signal shown in Figure 37a is multiplied by the digital 
Pieter shown in Figure 33b with indices equal to 1, 1257 
i257,'°250. Note that the signals andwtransform in 

Figure 5 are all 512 points long. The resulting resolu- 
tion-enhanced signal is shown in Figure 37c. 

Higher, derivatives of a signal have been used to 
obtain further peak sharpening (71-73). A second deriv- 
tive may be obtained by two successive applications of 
the filters shown in Figure 33b and 33c resulting in 
the overall filter shown in Figure 34a. It was found 
that very similar results could be obtained with a 
single application of the filter shown in Figure 33d. 
The resolution enhanced signal obtained using this 
filter (Figure 33d) with indices equals to: 25712575125; 
250 is shown in Figure 37d. Resolution enhancement is 
greater than that obtained in Figure 37c although the 


negative sidelobes, characteristic of second derivative 
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Figure 37. Resolution enhancement using "differentiation" 
and "deconvolution" Fourier domain digital filters. 
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resolution enhancement procedures, are also increased 
in magnitude. 

Finally i@tg1sralso’ possible), using filters: such 
as those shown in Figure 33e and Figure 34b, to approxi- 
mate deconvolution resolution enhancement techniques. 
Deconvolution, in the Fourier domain, is accomplished by 
dividing the Fourier transform of the observed signal 
by the Fourier transform of the response function (69, 
74). %In spectroscopy the signal is a spectrum and the 
response function is the resolution function. If the 
resolution function is assumed to be pina its 
Fourier transform will be a linear truncation function 
of a form similar to a filter with indices equal to 
O,eh A 1, eN4.) “Deconvolution amounts to multiplying the 
Fourier transform of the signal by the reciprocal of the 
Fourier transform of the resolution function which in 
this example would be an increasing hyperbola with a 
finite ivalue at OHz in the Fourier domain. Thus, appli- 
cation of the filters shown in Figures 33e and 34b 
approximates deconvolution. The main value of these 
filters for resolution enhancement is that with less 
attenuation of the low-frequencies there is less genera- 
tion of negative sidelobes. The spectrum resulting from 
the-applicatiion of: the filter shown in Figure 33 with 
indscesia 2540025, 125 9250L ts eshowneanerigures3 /e.y qkes 


solution enhancement is not quite as great as that shown 
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in Figures 37c and 37d but Sidelobe generation is reduced. 

These examples illustrate the power and ease of 
Fourier domain digital filtering. With the simple func- 
tions shown in Figures 33 and 34 a number of rather sophis- 
ticated signal processing operations can be carried out 
readily. In addition, an important aspect of Fourier 
domainidigital filtering \is* that!) iteis, din!mostscasées}'con- 
Siderably easier to design a digital filter in the 
Fourier domain than it is in the signal domain, i.e. in 
the frequency domain rather than the time domain. For 
example, the form of a Fourier domain notch filter is 
intuitively clear from Figure 36b while the form of a 
notch filter that could be directly applied to the 
Signal (Figure 36a) via the correlation equation is not 
readily apparent. Thus the Fourier domain approach to 
digital filtering considerably enhances an experimenter's 
capability in developing unique digital filters for 
specific signal processing needs. 

In conclusion, a major point that often bothers 
many who would like to use digital filtering techniques 
is the question of signal distortion. What must be kept 
in mind is that often the goal of digital filtering is 
optimization of the measurement of a particular signal 
parameter. If the desired parameter is peak height, 
then the matched filtering techniques discussed in Chapter 


Iv can be used (39-43). Although matched filtering dis- 
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torts peak shape, it optimizes the signal-to-noise 

ratio (peak height/rms base line noise) for peak height 
measurement. In contrast, the goal of resolution en- 
hancement is optimization of the measured peak position. 
This is often achieved by techniques, such as those 
presented in this chapter, that generate narrower spectral 
peak shapes, at times with significant distortion of the 
peak shape, in order to optimize the precision of the 
peak position measurement. In addition, resolution en- 
hancement is usually achieved at the expense of amplitude 
Signal-to-noise ratio. However, optimal processing of 
the spectral information for both peak height and peak 
position cannot be simultaneously achieved using a single 
filtering operation. Unique digital filters would also 
be necessary for the optimal measurement of other peak 
parameters such as area and width. Realization of this 
important concept facilitates intelligent and effective 


utilization of digital filtering techniques. 


Be Frequency Response of Savitzky-Golay Filter Functions 


Tn 1964). an himpontantrelass sof iconrelationeiune= 
tions for processing chemical signals were made popular 
by Savitzky and Golay (62, 75). Use of these functions 
represents the direct implementation of Equation 2 by 
means of a digital computer. A total of eleven different 


types of functions of various lengths were calculated, 
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allowing various degrees of Signal-to-noise ratio en- 
hancement, resolution enhancement, or differentiation. 
In light of the simplicity of the Fourier transform 
Toute Of correlation,)itiis particularly) useful to know 
the Fourier domain response of these functions, i.e. 
their frequency response (76-78). This was determined 
by Fourier transformation of the functions (by program 
DIGFIL) and determination of their amplitude spectra, 
i.e. the root sum-of-squares of the real and imaginary 
portions of the FFT output series. 

The frequency response characteristics of all 
eleven 7 and 21 point Savitzky-Golay filter functions 
are shown in Figures 38 and 39. Plots of the functions 
are shown in columns a and c of both figures with the 
frequency response plots shown in columns b and d. 
The vertical axis is the amplitude of the Fourier trans- 
form, and the horizontal axis is, frequency. Both axes 
are linear. The frequency axis extends from 0 Hz (dc) 
to one-half of the sampling frequency, i.e. the full 
unaliased range. Thus if a filter function was used to 
process a signal that was sampled at 0.01 sec intervals 
(100 Hz sampling rate) the corresponding frequency 
response plot of the filter isvinterpreted “as ‘extending 
Ero Omiiz 6bOo50 “HZ. 

In all cases the roman numeral designations of 


the filters correspond to those in the original tables 
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Figure 38. Seven and twenty-one point Savitzky-Golay filter 
functions (columns a and c) with their correspond- 
ing frequency responses (columns b and qd). 
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7-POINT FUNCTIONS 21-POINT FUNCTIONS 
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Seven and twenty-one point Savitzky-Golay filter 
functions (columns a and c) with their correspond- 
ing frequency responses (columns b and qd). 
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Of Savitzky and Golay (62). The corrected tables of 
Steiner, Termonia, and Deltour (79) have been used 
where appropriate. “This was necessary for filter fv 
(Zl point function) and both functions for €ilters v, 
pee eee X eX pea Xt. 

AS one-scans the figures, itsbecomes: clear that 
the interpretation of the action of each individual fil- 
ter is aided by a knowledge of its frequency response. 
Filters I and II perform smoothing with filter II having 
a somewhat higher frequency cutoff. The low pass nature 
of these filters is apparent as is the significantly 
Bower cutoff of the 21 point functions as*compared to 
the 7 point functions. For comparison a larger scale 
muguine Of the, frequencyresponse pilot on falters 1e(7 
point) is shown in Figure 40 along with the correspond- 
ing plot for a conventional single stage RC low pass 
fiiter. The two filters have equivalent 3 dB points#and 
Mence: cross at this point. 

All the remaining filters perform dim ferentratizon- 
Bielters brary and’ V ‘takeva"iirst derivative, filters 
Wieand View a» second, filtéers*Vili gand Lx7a thirds: foe 
terex a fourth, and filter Xia) ftith.~ As drscussed 
Seanlier,emulta plication Of he Pourien) trans lorm Ora 
signal by a linear ramp iS equivalent to taking Mtesyrirst 
derivative (69). As can be seen in Figure 38 for fil- 


ters dai LV, and V, this’is exactly the response in the 
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Fourier domain with subsequent low pass rolloff in order 
to suppress high frequency noise. The different initial 
Slopes of these three filters is analogous to different 
RC time constants for analog first derivative (single 
stage high pass) filters. Higher derivatives simply 
have increasing power dependence in the rising portion 
of their slope, i.e. ef for a second derivative; £? for 
a third, and so on. This follows from the Fourier domain 
representation of differentiation (69). 

In order not to unduly complicate Figures 38 and 
39, phase response plots have not been included. How- 
ever, a knowledge of a filter's phase response is 
necessary along with its frequency response in order to 
completely characterize the filter. Fortunately the 
phase responses of these filters are very simple. In 
all cases the phase angle is constant between succes- 
Sive nodes in the frequency response plots. The 
LrMoialy pnasey is 0 Stor’ filterswl Gell andi, +90 lator 
fostterce > Dee lV,. Verand Kiger SOee torah uoersr vie and Viiy 
and; -90° fort filters’ Vil Wand DxmeAbter Lhe jinwtiel 
lobe, the phase angle undergoes a 180° shift at each 
node. For example, the phase spectrum for the seven- 
point function: fore filter ~LIL,< which? performs: affirst 
derivative, is initially +90° through the first lobe, 
then -90° through the second lobe, and again +90° 


through the final lobe. 
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It is interesting to compare the plots of Figures 
38 and 39 with those presented earlier in Figures 33 
and 34. Although the detailed shapes of the trans- 
forms of the Savitzky-Golay filters are clearly much 
different than those of Figures 33 and 34, there is an 
Overall very strong resemblance between the first lobes 
in Figures 38 and 39 and certain of the forms resulting 
from One or more applications of the trapezoid of Figure 
33. This strong resemblance must hold, since low-pass 
filtering, differentiation, and so on all have a very 
specific Fourier domain representation. For example, 
the first derivative performed by Filter Va possesses 
a Fourier domain response almost identical to the tri- 
angle of Figure 33b; i.e. a linearly increasing ramp 
from the origin followed by low-pass filtering to re- 
duce the effect of high-frequency noise. Similarly, 
the Fourier domain representation of the first lobe of 
Filter VIIb, which takes a second derivative, closely 
resembles the filter of Figure 34a,.1.e. a, parabolic 
gncrease from the origin with subsequent. low-pass) f1i— 
tering. Although Savitzky and Golay present a total 
Of 116 different filter functions, =the effects Of these 
functions can clearly be approximated by specifying only 
four integers in the Fourier domain. 

The type of data presented in Figures 33, 34, 


38, and 39 is quite useful in interpreting exactly 
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what effects can be imposed by a given filtering opera- 
tion. In Chapter VI we will see how these digital fil- 
tering operations may be implemented in real time by 

an analog-based hardware correlation based on a tapped 


analog delay line. 


CHAPTER VI 


CROSS-CORRELATION II: THE TAPPED ANALOG DELAY LINE. 


Background 


As originally developed, correlation filters 
Such as those of Savitzky and Golay (62) ware aap tee 
to stored chemical signals by a software calculation 
using a digital computer, either directly or by the 
Fourier transform route of Chapter V. Direct imple- 
mentation of these or other correlation filters by 
analog means, although well-known under the name of 
transversal filtering (80), has been difficult because 
it requires that a short section of the analog signal 
be temporarily stored and made available in parallel 
form. The development of tapped analog delay lines 
in simple integrated circuit packages (34, 81) that are 
similar in concept’ to the SAM of; Chapter III has over- 
come this problem, and allows input chemical signals to 
be correlated with a weighting function in real time. 
In particular, ready application of the Savitzky-Golay 
and other correlation filters is now possible. 

Thesnature of a correlation filter as constructed 
from a tapped analog delay line is shown in Figure 41. 
Note that the output signal is the weighted sum of 
several sequential signal values that are simultaneously 
avarlable at the parallel outputs (taps) of the analog 


delay line. The correlation function may therefore be 
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selected simply by choosing the weighting function, and 
the correlation operation is performed by clocking the 
analog input signal through the delay line. Since this 
Operation may be performed very rapidly, a cross-cor- 


relation may readily be obtained in real time. 


Experimental 

The tapped analog delay line (TAD-12) was obtained 
from Reticon Corporation, 910 Benicia Ave., Sunnyvale, 
CA. 94086. It is a MOS circuit based on silicon diode 
array architecture (34) and is contained in a standard 
22 pin. IC package. ‘The organization of ‘the TAD is 
shown in Figure 42a. There are twelve independent de- 
PaAveoines with delays Of 1) 3,527.2) 723 aclock) pulses. 
The delay lines are all loaded and clocked simultan- 
eously. Thus, the "taps" are really the outputs of the 
12 analog delay lines. The tapped values are summed 
using an operational amplifier with the tap weights 
proportional to the meciprocal of the resistor value (see 
Figures 42b and 42c). The minimum recommended resistor 
walue as LOUK... A circuit evaluation \cardg(TC-i 2 irs 
available from Reticon that contains an operational 
amplifier as well as a TTL to MOS interface that produces 
the two-phase clock required by the TAD-12 from a single 
TTL clock. This circuit card was modified to allow 


resistors to be plugged in from any tap to either the 


PPO Dein a 4 i ae ec A ee 
i in ow nya pean 4 iy mah AN. 
He ne, oii } . Lr a er + ’ i Wien) ae iy ne aN f Loo bes 
bei 4 4 hy : | ae a ‘hed a Pr ve De \ -he@> & has 
PP RG Nee. Pepe tenes wee pilav on?) PAROS Y i ytqial bey 
; ( i! ; i apes pe eee ; ' uD ang % Vi at ee r WE et . 1+ y © y 
i rh ae 21) eh wen) Sats iy oh / : Ry 
’ I Ny j i ' ae | \ ; : AEE pai hy } ou! 
“ ‘ nile ‘ fae ae - eo 
! . OLS a Hen jay eh Rags sxe dS 
ry i bs é oon ve at Ut: so DL A 
i ey Vata ay 
y : ad f aa ™ y oe t, Pnewel 
i + i: ae ‘© w SebsA iG hat 2 Ri. Gael i, Vo Ay ' 
i } : Oi au z Hy : 
i i ee i he a. i Js 
‘ F spite r ¢ pity . f 4 al 
Ta | es ent if bas oo 
: Pep Se —" 
| ees ae ‘tort xe Ms 
at A 4 me ~ ae To HS, - a .* nb KS 
i ee ‘ Bere (7 ; " 
: ie fei if e 
Pineal 
5 Dh ta = 
pea as 
' “Vea Na ; 
é ss 
| ¢ . } { a4 > 4 7 [ ft 
} 4 
wen ee Lie yatss 1 
} Ps > . 
¢ ee Mat, AAs 
MOU E LE } i}: ee EU he. 4 Meh Be 
; t . m a 
" +e on re 42 
VIShRHSE 6, A toms Cb ree APS) pie ip 
Mt . . 
A , F ‘ 
if Gs at Yo ol Senkwepee OAT. vapitosg 2 
j * 1 rom 
} i 
' 4 . mm = 
PTS t of Oe) vit a IU. 
> + ‘ 7 : 
s q : , i 7 f ; ¢ 5 
: . ’ a ’ at . ro aa in vole 
: my f : he ; 5 Sb a core : ak ) 
"y  o. Ti i ps4 ty - ‘ aA eit eae! , wee. } sia TAR. daar \ 
| “4 rpg " 4 ~ 4. an - Pa eevee Z 
i ie ii oe Tit Fi ie ‘ a f V 3 ‘ge i we af a 802 . ; 
‘ 
: a oF 4) 
ders ips = a ey? t ; i} eat Ci av ad eee Qolénes 
; zi : ; : a t ’ : o . | is 
‘ \\ 5 ? ae > 
; i re re oA 
. : : a on mere ' a t iP LS al t oss i‘. ft ay at 
cao ee ila, he el labile Ta tin Bh 
é v \ 
: i : 
| | } | AP ees Das 
ie oT} | ; . a ‘ 
eh Seen) evLay WseLees ‘os wn. Te ea Tt one Co Jer a13369 RG 


WO . Sesahded! petnetieobe: momichn Ma ath Bae ach anne 2! 


7 - iy ‘ 


7 iy 


1 ie f j ' rie 7 = 
es eee 7 

mr ak (Si-28) Bubo cotteciave 3 tanred 2 A 9 it Ea tet CF 
Lae: «6 fareigeregp as easasAge sai tests os nox? eldnttaw baw ve 


i? : ’ a 1 ; P) 


; a ‘- } eur tty oy jacks Soet 287 mi eM as se a Z e iiaw aia 
am ay" r 


it 7 yy : VY t ; ; ’ r ie 
- v ; ys i i ae Y j aL : Pe i te a 
alpnie’ a Mota BLP aRe eth waive tools sendy 
F t ‘ i : a Li 
va ) ONG 4 \ ? ‘ j zy 


d ? oe ae ‘ . 
Walls ad Esa ateitae fa” Htha, 
j ; J ey | ¥ f 


b} } 
Tata iy J, 


ae ond inact: oa, ie Us. gH ed 


Figure 42. 


141 


ANALOG SIGNAL INPUT 


Tap 1 Out 
Top 2 Out 
Top 3 Out 


Tap 11 Out 
Top 12 Out 


CLOGS 
SIGNAL 


TAPPED ANALOG DELAY LINE 
Nea a4) Sake) oe 8 se iO tea t2 


(a) Organization of TAD-12. (b) Implementation 
of a transversal -filter iwi thy TAD-12., weighting 
resistors and operational amplifier. (c) Tap 
weights, for Figure sZb. 
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inverting or noninverting inputs. Thus the weighting 
function could be changed quickly and easily. 

The TAD-12 has a specified maximum clock rate of 
5 MHz, retention time of 40 msec, analog Signal band- 
width of 2 MHz, signal-to-noise ratio of 40 dB and 
acquisition time of 25 nsec. When utilized with the 
TC-12 evaluation card power is required at +5 V and +15 V. 

The linearity of the TAD was determined by measur- 
ing the input and output amplitudes of a 1 kHz sine wave 
for the twelfth tap, which would be expected to exhibit 
the worst linearity. These data are shown in Figure 43. 
A least-squares treatment of the data for inputs in the 
range of 0.12-6.0 volts peak-to-peak yielded a slope of 
On 5074 +) 0.0071L75, yan intercept of O20s2 2.0 .0229 Vi eand 


amcorrelation coefficient of 075999478. 


Results and Discussion 

With a conventional low pass filter most weight 
is given to the most recent signal value with exponen= 
tially decreasing weight given to past signal values. 
In their original paper (62) Savitzky and Golay dis- 
cussed the fact that such a filter introduces distortion 
into the filtered signal because future signal values 
have no influence. They went on to indicate that a 
symmetrical exponential function would make a more ideal 


low pass filter as both past and future Signal values 
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Erguret48 sifOutput ivs, input.of ithe twelfth tap of the TAD for 
a Sine wave Signal. 
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would be used in determining the output. The real time 
implementation of such a filter response is essentially 
impossible with conventional techniques and such filters 
are normally implemented on a signal stored within a 
digital computer. However, a low pass filter with a 
symmetrical exponential weighting can easily be imple- 


mented on an analog signal in real time using a tapped 


analog delay line transversal filter. This is illustrated 


in Plate 6. 

The signal source was a photodiode array spec- 
trometer (37). The present analog filters in the 
measurement system were by-passed and the raw output 
Signal fed directly to the TAD. As can be seen in the 
upper trace of Plate 6a this raw signal is highly cor- 
rupted with a 45 kHz fixed pattern noise from the photo- 
diode array readout clock. The symmetrical exponential 
low pass filter is very effective in removing this 
fixed pattern noise (See lower trace of Plate 6a). 

key. vactable in the utilizabironygo® thes tApers 
tes clock rate. ~For the lower trace™or Plate 6a the 
TAD clock rate was 240 kHz, which seemed to provide the 
"best looking" output signal. By varying the clock 
rate the width of the filtering function can be adjusted 
relative to the signal information, in this case the 
Spectral peak. What this amounts to, in other terms, is 


that the clock rate provides a very easy and effective 
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PHOTODIODE 
ARRAY 
SPECTROMETER 


45 kHz CLOCK 70 kHz CLOCK 


90 kHz CLOCK 650 kHz CLOCK 


Plate 6. Application of a symmetrical exponential TAD 
transversal filter. 
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way to control or set the high frequency cutoff (i.e. 3 
dB point) of the low pass filter. In addition, since 
the TAD is a sampled data processor the aliasing aspect 
of the clock must also be considered. These aspects 
of the clock are illustrated in Plates 6b through 6e. 
AC arTAD clock’ frequency-oOr 45 kHZ (Pilate 6b)¥ 
there is essentially complete destruction of all signal 
information because 45 kHz fixed pattern noise associated 
with the photodiode array output signal is aliased into 
the passband of the filter. When the TAD clock is in- 
creased to 70 kHz (Plate 6c) the array signal is rather 
heavily low pass filtered with the spectral peaks sig- 
nificantly broadened. This illustrates the situation 
where the filter function is too broad (i.e. 3 dB point 
too! low) 4 relative to=the’ signal information .°in*con-— 
ventional terms, the "time constant" is too long. How- 
ever, note that the peaks remain symmetrical even with 
such heavy low pass filtering. With a comparable time 
constant a conventional low pass filter would have sig- 
nificantly skewed the spectral peaks. A 90 kHz TAD 
clock frequency again results in aliasing of the fixed 
pattern noise into the itilter® passband (Plate 6d) . 
Finally, increasing the TAD clock to 650 kHz (Plate 6e) 
results in a weighting function that is too narrow. 
The peaks remain sharp but the fixed pattern noise is 


only partially removed. This series of photographs 
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Clearly illustrates the unique importance of the clock 
aS a variable for optimizing and controlling the charac- 
teristics of a TAD transversal filter. 

In interpreting the action of a weighting func- 
tion as a filter it is particularly useful to know the 
frequency response characteristics of the filter. The 
theoretical frequency response of the symmetrical exponen- 
tial weighting function is shown in Figure 44. It was 
calculated by taking the Fourier transformation of the 
eleven tap weights with program DIGFIL. Note that the 
frequency axis extends from OHz (dc) to only one- 
quarter of the TAD clock frequency. One would expect 
that the frequency response plot should extend to one- 
half the TAD clock frequency as that would be the full 
unaliased range. The confusion arises here because 
the output delays in the TAD are separated by two clock 
pulses. Thus, in terms of units of clock time, the TAD 
actually has another 11 taps, each with a weight of 
zero, interleaved wiltth the existing 12 taps. When a 
symmetrical exponential weighting function with inter- 
leaved zeros is transformed the frequency response plot 
shown in Figure 45 results which now extends to one-half 
the TAD clock frequency. In general we have worked 
with frequency response plots such as those shown in 
Figure 44 but it must always be remembered that the full 


unaliased range has a response of the type shown in 
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Figure 45. 

The experimentally determined frequency response is 
also shown in Figure 44. It was determined using a 
Sine wave generator as the signal source. Note that the 
agreement is quite reasonable even though no attempt was 
made to accurately trim the weighting resistors to exact- 
ly fit the symmetrical exponential function.’ 

As shown in Figures 44 and 45, the symmetrical 
exponential TAD transversal filter is an example of a 
filter that does not introduce any phase shift. This 
is, in fact, the key characteristic that allows peak 
like signals to be low pass filtered without introducing 
skew. In addition, this is a filter characteristic 
that is essentially impossible to achieve with active 
Or passive RC filters. The frequency response and 
phase plots of a Single-sided exponential weighting 
function which approximates a conventional single stage 
RC low pass filter is shown in Figure 46. In this case 
the phase response varies through the passband of the 
tfalper. It is this phase shift characteristic ‘thatecan 
generate asymmetrical peak distortion and displacement. 
If, however, the decaying exponential shown in Figure 46 
is reversed so that the twelfth tap has the most weight, 
the frequency response is unaffected but the phase res- 
ponse is inverted. This suggests that the TAD can be 


used with exponentially increasing tap weights to correct 
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for peak asymmetry produced by excess RC filtering and 
perhaps, in more general terms, be set up to correct 
for any Signal distortions induced by an instrumental 
response function. A simple feasibility example of such 
an application is shown in Figure 47. Heavy RC filter- 
ing was applied to the output signal from the photo- 
diode array spectrometer and the TAD was used to resym- 
metrize the peaks. The computer data acquisition system 
associated with the Broeoacne array spectrometer was 
used for background subtraction and plotting of the 
digitized array signal. With moderately heavy RC fil- 
tering and the TAD out of the circuit, skewing of the 
spectral peaks is evident (Figure 47a). However, with 
the TAD in the circuit peak symmetry is restored 
(Paqure 47b).. 41n particular, the small’ peak in the 
middle of the spectrum is better resolved from the 
skewed edge of the large peak. In this example the TAD 
can be thought of as a high speed analog preprocessor 
to the tdigutal data acquisition System. “~Gincesitvacts 
in real time it performs the resymmetrization cross- 
correlation operation at the 45 kHz data rate or in 
about 20 msec for a 1000 point signal. 

Differentiation of a signal may be accomplished 
by uSing one of several functions presented by Savitzky 
and Golay. Some results of using an eleven point first- 


derivative TAD transversal filter (Table III of reference 
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62) to differentiate a square wave are shown in Plate 

7. The TAD clock frequency was 200 kHz for all measure- 
ments. The application of a 100 Hz square wave results 
in the output of sharp positive and negative spikes from 
the TAD, i.e. the square wave is differentiated. When 
the square wave frequency is increased to 500 Hz the 
Spikes are still present, but are considerably less sharp. 
An input square wave of 6000 Hz is output as a sine wave 
and input of a 10,000 Hz square wave results in integra- 
tion of the square wave and thus a triangular wave out- 
put. This behavior is easily explained by referring to 
the frequency response plot shown in Figure 48. 

It can be seen that the TAD differentiator is 
really a bandpass filter with a peak response at about 
6000 Hz and its first node at about 13,000 Hz. When the 
input square wave frequency lies low on the rising por- 
tion of the curve (point al = 700 (Hz)F "a good differencial 
results because all the lower harmonics also lie on the 
rising portion of the curve. When the input square wave 
frequency is increased to 500 Hz (point bb), Ondys the 
harmonics to the llth (5500 Hz) lie on the rising portion 
of the curve and the quality of the differential is not 
asuhigh. An <input square wave 1o£ 6000°HZs (point) c)falis 
at the maximum of the bandpass and is therefore output 
as a sine wave. Square wave signals such as 10,000 Hz 


(point d) occurring on the falling side of the bandpass 
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Plate 7. Application of a TAD transversal filter’ to 
"differentiation" of a Square wave. 
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are integrated. Clearly the frequency response plots 
obtained by Fourier transformation of the weighting 
functions are quite useful in understanding the charac- 
teristics of the cross-correlation operation. 

Resolution enhancement of peak type signals can 
be carried out by taking the second derivative of the 
Signal. A TAD transversal filter was set up with an 
eleven point Savitzky-Golay second derivative weighting 
function (Table VI of reference 62 and Table III of this 
thesis) in order to test its utility for resolution 
enhancement. It was used in inverted form so as to 
give positive peaks. The test signal was a de arc spec- 
trum of Cu and Ge in a ZnO-graphite matrix previously 
acquired with a photodiode array spectrometer and 
computer system, and stored on DEC tape. This 
Signal is the same as that given in Figure 37a (Chapter 
V). In order for it to be processed by the TAD second 
derivative filter it was output from the computer through 
aeDAG at a wate of 50 KHz (signal ws 5127 points ten). 
Photographs of expanded scope traces of the first (column 
I) and last (column II) sections of the signal as out- 
putted from the DAC are shown in Plate 8a and as 
processed by the TAD in Plate 8b. The TAD clock rate 
was 120 kHz. 

The theoretical frequency and phase responses of 


the Savitzky-Golay ll-point second derivative filter 
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TABLE. sud 


Generation of TAD Resistor Values from Savitzky 


Golay Weights (11 Point Second Derivative) 


|1/ Weights | 
Raw S-G Smallest scaled Nearest Resistor 
Weights co 10 20ns 2a Value (kvonms)) 
5 10.0 10 
6 25.0 27 
=-] 150 50 
-6 25:30 27 
= 9 EO a0 18 
=10 1570 1a) 
“Se, G76 18 
AS 25 0) 27 
au 150 150 
6 25%,.0 P27) 
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Plate 8. 


Second derivative resolution enhancement. 
(a) Signal ,. (b)a@AD tl pointetii tex, 

(c) software 9 point filter, (d) software 
11 point filter, and (e) Fourier domain 
digital filters See text for discussion. 
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are shown in Figure 49a. However, the resistor weights 
actually used did not correspond exactly to the theoreti- 
cal weights (see Table III). When the Fourier trans- 
formation of the actual resistor weights is taken the 
frequency and phase responses shown in Figure 49b result. 
Now there is a small response at dc and a low frequency 
lobe. The reason for the small response at dc is the 
fact that our resistor weights did not sum to zero 

while the true Savitzky-Golay weights do. The 
experimental points shown in Figure 49b verify a small 
response at dc but the low frequency node was not 
observed. 

The responses shown in Figure 49 illustrate that 
relatively small mismatches in resistor weights to 
theoretical weights can Significantly alter the filter 
characteristics. This was also observed for several 
other TAD filters where, in particular, the position 
and relative amplitude of side lobes was altered by 
small resistor mismatches. However, with the Fourier 
transform program of Appendix II it is easy to type 
in any particular set of tap weights and thereby calcu- 
late the frequency and phase responses to be expected. 

Finally, it is useful tovbrietly compare che 
resolution enhancement capabilities of the TAD second 
derivative filter to two other methods: (1) the con- 


ventional software application of a Savitzky-Golay filter 
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Figure 49. Frequency responses for the theoretical 
(a) and actual (b) tap weights of the TAD second 
derivative filter. Circles in (b) represent ex- 
perimental values for the frequency response. 
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and (2) The Fourier domain digital filter of Chapter 

V. The test signal is the dc arc spectrum shown in 
Figure 37a and the results are presented in Plates 8c 
through 8e. Results obtained by the software applica- 
tion of 9 and ll-point Savitzky-Golay second deriva- 
tive functions to the dc arc spectrum are shown in 
Eratesi8cland.8duiliiteis:importantitomnotehthat Ptpis 
the results shown in Plate 8c for the 9 point function 
that are most similar to those shown in Plate 8b for 
the 11 point TAD implementation. The reason for this 
is that the TAD allows independent control over 

the width of the filter function through the TAD clock. 
Recall that for Plate 8b the Signal was clocked out of 
the DAC at 50 kHz and the TAD was clocked at 120 kHz. 
Because there are two clock pulse delays between taps the 
effective clock rate with respect to the taps is 60 
kHz. Thus the TAD 11 point weighting function is 
slightly narrower relative to the signal information 
than when) iteisvapplied) directly by\isoftware.) (Based 

on the relative differences in the clock rates, (50 kHz 
Signal and) 60-kHz filter) it would be expected that the 
11 point TAD would achieve resolution enhancement more 
comparable to that of a 9-point filter as indicated by 
the photographs in Plate 8. This control adds con- 
siderable flexibility to the TAD implementation in that 


the width of the filter can be fine tuned to the desired 
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performance by varying the clock frequency. 

The results obtained using the Fourier domain 
digital filter of Chapter V that approximates second 
derivative resolution enhancement are shown in Plate 8e. 
The filter used was that shown in Figure 32d of Chapter 
Vews Chtindices “equal +to#25', (125 Ar1L25 and#2500> Again 
very Similar results to those obtained with the TAD are 
achieved. However, it is important to note that the 
TAD resolution enhancement was carried out in real time 
or in about 10 msec for the 512 point signal presented 
at a rate of about 50 kHz. The direct software applica- 
tion of the Savitzky-Golay filter took about 20 sec and 
the Fourier domain digital filter about 2 min, both pro- 


grammed in FORTRAN and run on a PDP 8/e minicomputer. 


Conclusions 

Clearly the TAD is a remarkably versatile device 
for implementing cross-correlation in real time. Only 
some!of its many capabilities (37) ‘have’ been a1ilustrated 
here. Also the present device is among the first of 
thas type of ‘circuit to become available. s thescharacter— 
istics and capabilities of tapped analog delay lines 
may be expected to improve with further advances in 
solid-state technology. Already Reticon has announced 
a 32 tap device with a 60 dB dynamic range. One can 


envision tapped analog delay line transversal filters 
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being incorporated in a wide variety of scientific in- 
strumentation as flexible analog data processors. A 
simple combination that we have found effective is to 

use a TAD as an output processor for a transient recorder. 
Thus, once a Signal is acquired, it can be recirculated 
and hence processed in any number of different ways 


with the TAD. 


iW | 


CHAPTER VII 


SUMMARY 


In the foregoing chapters, we have seen how cor- 
relation instrumentation of varying levels of complexity 
can be used to manipulate chemical data in a large number 
of ways. The simple block diagram presented in Figure 4 
represents a variety of uniquely powerful instruments 
that can be applied to a large number of different measure- 
ments. Future developments in integrated-circuit tech- 
nology will simplify even further the application of cor- 
relation techniques. For example, progress can be ex- 
pected both in digital filtering techniques with the 
development of microprocessors and their support circuitry, 
and in analog methods of correlation with further develop- 
ment of devices based on bucket-brigade, charge-coupled 
device, or diode array technology. Performance of these 
devices will be enhanced and costs will drop as fabrica- 
tion procedures improve and yields increase. Therefore, 
more and more sophisticated instrumentation will become 
available in future years. 

Two different paths of development can be dis- 
cerned in the use of correlation instrumentation. First, 
high density fabrication procedures for logic circuitry 
have allowed the development of single-chip microprocessors 
such as the eight bit Intel 8080A and Motorola 6800, the 


twelve bit Intersil 6100, and the sixteen bit TMS 9000. 
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A large variety of different support chips are also be- 
coming available that allow relatively simple expansion 
of these basic microprocessors into microcomputers. 
Since direct implementation of Savitzky-Golay filter 
functions is possible with a programmable desk calcu- 
lator (82), as the price of microcomputers drops and the 
level of performance increases, applications such as 
digital filtering will become more and more facile. 

Simultaneously with the improvement in digital 
circuitry has come futher development in analog circuit 
design (34). Later generation SAMs and TADs will contain 
more storage elements and provide a much improved dynamic 
range. Therefore, the ease of analog-based correlation 
operations will also improve in coming years. 

In cOnclusion, we have also seen in the foregoing 
chapters that correlation methods can be used both to 
enhance the ease of measurement and to modify selectively 
the characteristics of the information obtained. There- 
fore, the approach to measurement from a correlation view- 
point can often yield new insight into factors involved 


in the measurement process. 
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APPENDIX I 


The voltage output of the correlator of Chapter 4 
was digitized with a digital voltmeter and printed on 
a teletype by means of a SERDEX SERial Data EXchange 
Module (53, 83-84). These modules allow communication 
of a DVM or other device using parallel BCD output code 
with a teletype a computer that utilizes serial ASCII 
(American Standard Code for Information Interchange) 
code’. 

A block diagram of the SERDEX module is shown in 
Figure 50. A signal from a teletype is received in the 
isolated current-loop receiver and converted from 
Serial to parallel ASCII. A decoder then recognizes 
either a question mark (?) or one of Six control 
characters (%, $, =; "4 *, -and-owvtnuts..a pulse if 
one of these characters has been received. All other 
characters are ignored. The question mark can be 
used to trigger an analog-to-digital conversion. The 
completion of this conversion (as indicated by a change 
in STATUS) then loads the BCD output of the ADC into 
the SERDEX and initiates data transmission. The BCD 
digits are then loaded word serially into a parallel 
to ASCII converter, and sent to the teletype via the 
isolated current loop transmitter. 

A full schematic of the SERDEX module as con- 


nected to a teletype and DVM (DANA Model 5400 modified 
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ASEM WTO 


ISOLATED 


CURRENT LOOP PARALLEL 
RECEIVER CONVERTER CONTROL 
CHARACTERS 
CONTROL 
CHARACTER 
DECODER 
CONVERT 
COMMAND 
ISOLATED PARALLEL TO 
CURRENT LOOP ASCII ADC 
TRANSMITTER CONVERTER 


STATUS 


PARALLEL IN / SERIAL 
OUT SHIFT REGISTER 


Figure 50. Block diagram of the SERDEX module. 
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to be TTL compatible) is shown in Figure 51. The tele- 
type is connected via a twisted wire pair to an active 
20 ma current source formed Sy Oly “Dis, RL and» R2Z7and 
thence to the isolated current loop transmitter and 
receiver, which are connected in the half duplex mode 
(84). The clock driver (SCL 1006) is wired to provide 
operation of the SERDEX at 110 baud transmission rates. 
Control inputs are wired for 8 data bits per character 
with no stop bits and without parity verification. The 
connection of the serial inputs to the receiver regis- 
ter outputs allows the user to type an eight digit test 
message and verify its reception by typing a slash (/), 
cauSing the system to echo the message. In the imple- 
mentation shown, the control character outputs and 

the convert command (?) are not used; rather, the 
experiment itself initiates A-to-D conversion. A valid 
BED output/is indicated by a 0>1 onjthe PRINT line; this 
toggles Mono-1 (set for about 1 sec) and initiates 

data transmission. A total of eight words can be trans- 
mitted without external expansion of the SERDEX. The 
first word is used to indicate the voltage polarity: 

if positive (POLARITY = 0) it will be 0000; if negative 
(POLARITY, = 1) at) wild bent l0Go 4 tne addition ofetne 
remaining bits of the eight-bit ASCII code make these 
numbers 10110000 and 10111100 respectively. These are 


printed by the teletype as "0" for positive voltages or 
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"<" for negative voltages. The reason for not indicating 
negative voltages with a minus sign (-) will be dis- 
cussed later. 

After the sign character has been transmitted, 
ene four BCD digits for the voltage’ (in*’millivolts) are 
converted to ASCII and transmitted in order. The 
Sixth word is wired as 1101 (Sl open) or 1111 (S1 closed), 
whereas the seventh and eighth words are wired as 1010 
and 1111 respectively. The SERDEX module recognizes 
1111 as a command to cease transmission; hence the 
seventh and eighth words may or may not be printed 
depending on the position of Sl. The stop character 
itself, although transmitted, is not printed. 

The function of gates Gl to G4 is to recognize 
the four-bit words 1101 and 1010 and change the fifth 
and sixth ASCII bits so that they will be transmitted 
as 10001101 and 10001010 respectively. They are there- 
fore interpreted by the teletype as carriage return 
and line feed respectively.” Thus; Ss) can be used to 
control whether or not the teletype automatically 
Carriage returns and line féeds after the printing of 
a vOlLtCage. 

It was mentioned earlier that a negative voltage 
was indicated by an ASCII "<" rather than a minus Sign. 
Examination of a table of the ASCII code shows that a 


minus sign is indicated by 20102 10s kthe. last four 
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bits of this word (1101) are exactly those interpreted 
by gates Gl to G4 as carriage return; hence, the above 
circuit could not distinguish between the two. This 
limitation may be corrected by employing a flip-flop to 
change the state of bit 5 (D13) to 0 when the first 


wordsi1s transmitted (84) . 
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The data presented in Chapter 5 and 6 were largely 
obtained by a computer program called DIGFIL. This pro- 
gram was written in FORTRAN II for a DEC PDP 8/e mini- 
computer with a DECtape based 0S/8 operating system and 
LOoK Of -COre. 

DIGFIL is a general-purpose Fourier transform 
program using the Fast Fourier Transform (FFT), and is 
an extensive modification of an earlier program (FFATOD) 
written by E. G. Codding. DIGFIL will accept input either 
from teletype or DECtape, and will allow output to 
teletype, DECtape, an oscilloscope, or a chart recorder. 
The Fourier transformation section allows apodization 
either by the trapezoid of Chapter 5, or by a function 
stored earlier on DECtape. Output of the FFT section 
may be either the real, or imaginary series, or the 
amplitude spectrum. The phase spectrum may also be 
calculated if desired. The amplitude spectrum may also 
be phase corrected versus a reference stored in IPR: 
this: featucesa Llowsyu calculation Of sphase-corrected 
amplitude spectra of interferograms obtained with a 
Michelson interferometer. 

For proper operation, SUBROUTINE COOLTK is re- 
quired. This subroutine is a modification by G. Horlick 


of a program written by Singleton (65) that allows 
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PROGRAM CIGFIL 
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